-- Logs begin at Wed 2022-08-17 18:52:16 UTC, end at Wed 2022-08-17 20:36:54 UTC. -- Aug 17 19:54:25.840723 dv-cinder-820027-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:54:25 2022] *** Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: nodename: dv-cinder-820027-19-iscsi Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: machine: x86_64 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: clock source: unix Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: pcre jit disabled Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: detected number of CPU cores: 4 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: current working directory: / Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: your processes number limit is 47680 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: your memory page size is 4096 bytes Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: detected max file descriptor number: 2048 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: lock engine: pthread robust mutexes Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: thunder lock: enabled Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 19:54:25.852453 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:54:25.891632 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: Python main interpreter initialized at 0x56282edfd9c0 Aug 17 19:54:25.891632 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: python threads support enabled Aug 17 19:54:25.891632 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: your server socket listen backlog is limited to 100 connections Aug 17 19:54:25.891632 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:54:25.892000 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:54:25.892000 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: *** Operational MODE: preforking *** Aug 17 19:54:25.892299 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:54:25.892299 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: spawned uWSGI master process (pid: 105502) Aug 17 19:54:25.892489 dv-cinder-820027-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 19:54:25.893741 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: spawned uWSGI worker 1 (pid: 105503, cores: 1) Aug 17 19:54:25.893741 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: spawned uWSGI worker 2 (pid: 105504, cores: 1) Aug 17 19:54:25.893741 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:54:26.544125 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:54:26.554612 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:54:27.612859 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:54:27.612859 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 17 19:54:27.613419 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:54:27.613419 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: from cryptography.utils import int_from_bytes Aug 17 19:54:27.613862 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:54:27.613862 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 17 19:54:27.613976 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:54:27.613976 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: from cryptography.utils import int_from_bytes Aug 17 19:54:30.071642 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:54:30.072252 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:54:30.072350 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:54:30.072739 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:54:30.072983 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:54:30.073361 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.073702 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.074015 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.074325 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.074650 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.074971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:54:30.075372 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.075457 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:54:30.075540 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.075540 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.075762 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:54:30.075851 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.076125 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.076276 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:54:30.076385 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:54:30.076473 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.076733 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-19-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.076875 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077046 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077193 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077323 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077423 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077668 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077825 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.077957 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078061 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078259 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078350 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078568 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078863 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.078952 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.079185 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.079356 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.079459 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.079739 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.079829 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080050 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-19-iscsi {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080139 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080352 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080444 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080632 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080760 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.080926 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081011 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081247 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081388 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081528 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081642 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.081867 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082000 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082163 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082260 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082467 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082661 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082841 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-19-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.082985 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083165 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083262 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083471 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083561 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083775 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.083873 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084153 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084248 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084461 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084551 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084754 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.084854 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085070 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085160 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085381 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085469 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085704 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.085828 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086023 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086123 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-19-iscsi {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086331 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086423 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086645 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086804 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.086941 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087030 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087237 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087344 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087539 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087658 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087832 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.087963 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088134 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088277 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088431 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088605 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088728 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088909 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.088995 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.089229 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.089322 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.089578 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.089687 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.089884 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090031 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090245 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090399 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090501 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090724 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.090828 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091032 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091120 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091346 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091443 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091643 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091730 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.091942 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092029 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092239 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092333 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092484 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092577 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092791 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.092886 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093108 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093202 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093634 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093722 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.093960 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094049 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094209 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094316 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094454 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094626 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094770 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.094923 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095090 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095234 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095396 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095620 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095713 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095846 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.095988 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096147 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096290 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096472 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096589 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096781 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.096879 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097083 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097253 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097389 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097584 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097724 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.097903 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098024 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098216 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098315 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098532 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098630 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098835 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.098921 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099151 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099250 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099492 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099651 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099793 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.099946 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100165 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100307 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100441 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100582 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100718 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100853 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.100995 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101142 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101275 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101432 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101604 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101737 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.101893 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102035 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102176 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102312 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102454 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102596 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102754 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.102895 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103031 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103171 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103313 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103463 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103604 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103754 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.103887 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104027 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104162 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104307 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104441 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104576 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104713 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104846 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.104977 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105119 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105260 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105407 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105572 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105705 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105839 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.105984 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.106125 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.106394 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.106594 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.106743 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.106883 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107031 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107165 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107295 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107429 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107577 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107722 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107865 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.107999 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108145 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108280 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108421 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108564 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108706 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108841 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.108974 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109106 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109238 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109390 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109590 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109696 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.109881 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110016 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110196 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110339 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110428 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110546 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110735 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.110870 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111027 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111176 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111304 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111414 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111619 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111755 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.111891 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112005 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112205 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112340 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112467 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112573 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112805 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.112954 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113091 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113190 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113409 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113580 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113763 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.113851 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114023 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114158 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114329 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114474 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114654 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.114789 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.114962 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.115093 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.115262 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.115412 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.115511 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.115594 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.115830 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.115935 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.116129 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.116228 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.116427 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.116525 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.116719 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.116809 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.117036 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.117135 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.117347 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.117438 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.117669 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.117764 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.117974 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.118081 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.118274 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.118364 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.118586 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.118684 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:54:30.118890 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.118990 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119212 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119310 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119518 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119608 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119824 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.119932 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120137 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120228 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120428 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120542 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120736 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.120828 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121052 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121160 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121360 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121497 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121728 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.121830 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122034 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122127 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122344 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122437 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122652 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122739 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.122964 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123065 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123278 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123364 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123581 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123674 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123884 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.123972 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124188 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124274 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124500 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124586 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124814 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.124907 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125118 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125215 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125428 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125515 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125758 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.125867 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126063 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126156 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126366 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126452 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126672 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126758 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.126977 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127070 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127306 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127414 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127613 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127716 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.127918 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128013 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128221 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128306 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128527 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128620 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128831 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.128936 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129133 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129219 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129433 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129518 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129755 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.129858 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130059 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130161 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130357 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130479 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130656 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130751 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.130950 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131037 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131258 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131352 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131570 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131665 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131869 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.131957 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132177 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132261 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132479 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132564 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132782 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.132867 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133083 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133172 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133386 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133471 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133707 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.133795 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134007 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134105 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134308 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134393 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134602 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134686 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.134909 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135001 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135209 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135293 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135502 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135587 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135816 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.135988 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136111 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136206 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136408 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136496 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136711 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.136806 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137033 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137119 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137337 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137422 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137675 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137777 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.137977 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138072 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138292 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138386 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138599 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138686 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138903 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.138996 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139229 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139315 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139534 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139621 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139836 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.139923 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140152 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140277 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140454 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140595 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140757 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.140858 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141048 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141152 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141351 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141438 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141671 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141777 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.141967 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142064 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142262 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142350 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142564 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142659 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142858 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.142959 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143152 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143238 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143447 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143535 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143740 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.143835 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144036 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144130 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144349 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144443 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144650 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144737 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.144945 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145043 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145240 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145391 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145554 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145643 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145878 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.145964 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146175 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146260 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146474 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146561 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146781 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.146866 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147079 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147172 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147378 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147473 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147678 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147765 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.147979 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148072 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148280 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148367 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148582 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148675 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148884 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.148984 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149183 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149275 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149483 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149584 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149806 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.149904 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150117 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150216 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150419 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150507 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150735 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.150838 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151037 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151125 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151348 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151434 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151643 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151731 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.151949 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152037 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152259 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152344 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152566 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152707 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.152917 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153003 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153223 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153309 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153524 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153632 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.153953 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154155 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154239 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154454 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154540 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154755 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.154840 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155055 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155150 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155358 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155442 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155656 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155742 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.155954 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156053 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156253 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156339 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156567 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156652 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156867 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.156963 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157178 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157274 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157472 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157601 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157803 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.157899 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158111 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158195 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158417 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158503 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158722 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.158816 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159022 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159118 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159327 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159413 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159629 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159714 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.159933 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160018 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160237 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160334 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160533 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160621 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160832 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.160929 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161135 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161228 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161441 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161562 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161760 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.161859 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162060 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162145 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162356 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162451 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162664 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162752 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.162967 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163062 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163263 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163356 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163557 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163642 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.163859 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164020 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164162 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164254 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164461 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164553 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164764 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.164861 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165064 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165159 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165359 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165444 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165679 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165786 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.165983 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166068 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166282 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166367 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166576 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166664 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166871 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.166964 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167165 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167259 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167465 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167550 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167765 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.167852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168068 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168162 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168434 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168761 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.168847 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169067 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169153 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169373 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169468 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169702 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.169791 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170013 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170109 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170331 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170447 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170635 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.170939 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171039 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171236 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171328 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171536 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171622 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171834 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.171928 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172134 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172221 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172449 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172542 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172749 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.172848 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.173396 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.173489 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.173725 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.173823 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174026 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174112 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174330 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174416 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174633 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174719 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.174951 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175193 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175279 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175519 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175605 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175829 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.175928 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176132 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176223 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176436 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176522 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176741 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.176836 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177054 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177140 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177357 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177449 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177684 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177775 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.177989 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178094 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178289 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178382 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178587 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178673 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178885 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.178973 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.179189 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.179439 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.179532 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.179769 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.179856 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180067 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180160 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180375 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180673 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180773 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.180972 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181085 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181270 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181365 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181586 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181678 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181901 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.181988 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182201 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182298 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182506 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182602 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182804 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.182891 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183116 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183216 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183418 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183512 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183715 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.183807 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184061 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184154 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184358 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184487 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184692 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184805 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.184990 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.185107 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.185322 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.185410 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.185665 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.185755 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186002 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186089 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186302 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186399 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186599 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186683 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186906 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.186991 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187202 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187289 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187497 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187592 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187794 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.187962 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188091 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188169 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188390 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188484 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188682 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188776 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.188985 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189071 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189284 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189371 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189609 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189711 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.189917 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190003 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190210 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190305 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190520 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190643 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190817 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.190913 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191125 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191230 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191424 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191519 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191719 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.191806 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192012 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192097 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192315 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192403 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192618 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192704 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.192914 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193014 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193215 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193302 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193508 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193631 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193834 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.193931 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194131 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194226 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194428 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194515 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194724 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.194819 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195027 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195123 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195328 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195415 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195623 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195719 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.195940 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196027 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196234 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196320 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196527 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196622 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196821 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.196909 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197117 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197209 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197409 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197503 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197728 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.197816 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198027 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198130 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198323 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198413 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198621 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198709 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.198916 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199002 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199218 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199311 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199530 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199620 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199829 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.199916 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200124 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200242 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200423 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200548 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200715 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.200851 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201008 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201183 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201319 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201452 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201610 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201772 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.201913 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202071 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202227 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202376 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202528 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202691 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.202821 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203003 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203117 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203302 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203410 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203606 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203742 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.203905 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204035 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204205 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204384 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204502 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204683 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204809 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.204989 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205107 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205300 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205388 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205635 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205728 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.205939 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206026 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206242 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206330 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206537 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206623 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206839 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.206926 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207139 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207226 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207435 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207533 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207729 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.207814 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208022 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208109 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208334 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208428 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208636 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208723 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.208935 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209021 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209245 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209333 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209571 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209674 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209880 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.209973 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210185 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210279 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210484 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210584 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210779 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.210864 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211077 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211162 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211378 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211485 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211676 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211762 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.211972 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212056 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212269 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212364 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212569 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212661 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212872 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.212966 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213173 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213258 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213466 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213571 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213796 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.213885 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214097 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214185 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214396 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214481 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214705 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.214790 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215007 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215093 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215349 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215439 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215653 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215807 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.215977 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216084 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216241 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216391 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216536 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216696 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.216952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217041 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217256 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217342 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217588 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217870 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.217959 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218171 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218257 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218471 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218572 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218767 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.218853 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219066 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219159 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219360 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219457 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219661 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219772 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.219966 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220075 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220267 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220367 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220570 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220870 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.220956 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221220 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221318 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221706 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221855 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.221954 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222153 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222248 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222448 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222535 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222744 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.222838 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223141 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223342 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223427 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223639 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.223736 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224042 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224129 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224345 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224436 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224639 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.224942 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225047 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225242 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225348 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225555 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225661 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225863 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.225971 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226181 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226267 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226479 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226585 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226775 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.226870 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227072 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227161 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227387 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227474 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227685 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227771 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.227998 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228085 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228333 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228426 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228639 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228728 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.228934 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229042 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229247 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229373 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229576 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229714 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.229890 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230018 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230201 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230333 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230611 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230706 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.230973 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231063 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231283 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231401 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231595 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231685 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.231913 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232009 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232209 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232311 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232505 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232600 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232809 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.232904 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233105 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233201 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233401 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233487 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233739 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.233853 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234038 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234142 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234340 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234435 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234642 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234730 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.234940 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235072 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235236 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235388 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235531 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.235847 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236011 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236143 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236331 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236458 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236631 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236761 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.236930 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237076 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237238 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237390 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237562 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237713 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.237858 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238032 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238174 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238335 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238472 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238632 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238775 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.238928 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239079 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239224 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239387 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239558 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239685 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239860 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.239984 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240172 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240318 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240495 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240590 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240814 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.240901 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241120 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241235 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241440 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241529 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241792 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.241881 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242102 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242207 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242409 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242495 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242709 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.242795 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243007 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243101 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243300 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243385 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243594 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243678 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243887 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.243981 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244183 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244270 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244477 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244563 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244781 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.244870 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245075 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245161 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245373 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245497 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245842 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.245936 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246008 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246077 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246271 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246406 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246612 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246707 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.246913 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247091 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247208 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247393 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247506 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247690 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247801 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.247996 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.248134 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.248295 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.248432 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.248595 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.248749 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249075 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249162 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249391 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249479 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249723 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.249811 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250025 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250121 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250325 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250631 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250717 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.250928 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251021 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251232 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251324 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251531 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251616 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251827 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.251955 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252124 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252224 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252421 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252519 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252726 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.252821 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253043 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253231 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253368 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253566 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253696 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.253878 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254008 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254183 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254316 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254487 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254627 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254791 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.254932 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255092 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255244 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255394 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255556 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255696 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255868 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.255995 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256176 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256300 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256481 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256620 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256794 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.256935 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.257104 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.257256 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.257421 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.257612 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.257920 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258022 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258223 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258323 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258527 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258614 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258830 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.258923 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259164 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259258 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259470 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259558 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259773 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.259859 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260077 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260165 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260381 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260466 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260683 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260769 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.260986 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261073 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261287 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261373 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261611 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261780 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.261948 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262090 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262288 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262411 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262591 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262769 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.262894 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263081 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263197 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263392 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263509 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263704 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.263835 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264054 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264151 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264363 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264464 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264664 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264759 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.264980 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265066 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265290 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265511 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265616 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265843 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.265932 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266167 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266266 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266485 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266573 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266799 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.266885 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267104 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267203 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267407 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267501 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267714 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.267810 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268010 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268104 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268307 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268395 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268608 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268696 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.268908 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269078 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269207 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269293 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269522 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269680 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269850 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.269941 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270146 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270359 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270447 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270670 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270765 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.270995 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.271253 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.271340 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.271600 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.271704 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.271912 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272024 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272224 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272321 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272544 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272678 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272844 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.272933 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273145 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273233 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273451 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273605 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273775 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.273864 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274073 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274174 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274379 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274475 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274685 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274770 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.274983 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275076 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275280 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275375 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275585 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275679 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.275889 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276110 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276205 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276449 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276535 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276759 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.276844 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277074 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277169 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277373 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277461 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277732 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.277845 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278028 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278129 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278336 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278460 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278632 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278764 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.278931 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279066 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279228 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279381 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279525 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279687 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279831 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.279986 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280126 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280283 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280429 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280588 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280725 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.280894 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281030 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281196 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281324 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281500 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281656 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281822 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.281953 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282143 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282287 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282447 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282609 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282743 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.282905 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283045 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283236 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283368 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283516 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283654 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283790 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.283938 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284095 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284239 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284398 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284530 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284732 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.284868 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285036 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285178 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285341 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285578 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285692 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285904 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.285993 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286217 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286306 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286526 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286612 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286825 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.286920 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287138 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287224 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287436 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287524 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287733 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.287828 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288050 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288137 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288353 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288441 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288656 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288750 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.288957 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289043 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289261 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289345 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289582 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289684 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289892 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.289988 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.290193 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.290435 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.290530 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.290764 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.290851 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291068 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291154 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291369 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291465 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291668 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291764 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.291966 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292054 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292267 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292374 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292568 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292718 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.292887 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293023 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293178 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293353 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293608 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293742 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.293948 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294079 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294263 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294402 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294567 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294698 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.294870 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295001 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295174 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295306 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295476 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295630 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295783 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.295925 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296109 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296250 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296414 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296550 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296715 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.296854 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297018 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297153 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297326 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297464 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297656 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.297873 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.298345 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.298479 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.298623 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.298763 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.298932 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299075 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299242 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299379 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299554 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299714 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299884 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.299972 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300187 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300275 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300509 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300596 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300812 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.300911 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301121 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301207 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301447 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301642 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301771 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.301860 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302071 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302157 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302366 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302484 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302669 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302759 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.302978 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303065 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303283 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303379 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303583 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303671 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303880 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.303967 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304181 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304278 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304479 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304574 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304772 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.304868 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305065 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305154 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305449 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305688 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305806 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.305984 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306129 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306279 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306447 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306576 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306746 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.306873 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307044 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307167 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307343 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307462 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307645 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307763 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.307959 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308045 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308263 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308348 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308560 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308655 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308878 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.308968 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.309229 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.309601 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.309790 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.309891 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310160 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310275 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310466 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310595 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310766 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.310919 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311072 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311229 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311370 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311548 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311668 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311853 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.311966 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312171 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312259 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312489 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312576 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312797 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.312889 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313102 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313188 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313410 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313505 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313745 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.313845 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314044 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314132 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314341 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314436 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314640 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314734 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.314940 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315026 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315244 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315332 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315564 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315650 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315881 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.315976 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316179 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316266 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316492 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316584 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316796 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.316891 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317201 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317416 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317502 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317747 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.317842 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318051 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318137 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318359 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318444 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318664 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318752 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.318967 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319053 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319268 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319361 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319568 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319655 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319870 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.319955 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320169 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320255 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320470 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320566 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320777 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.320864 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321077 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321174 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321395 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321481 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321775 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.321878 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322027 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322123 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322340 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322426 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322646 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322742 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.322968 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323076 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323272 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323359 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323577 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323663 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323882 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.323978 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324190 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324278 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324558 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324648 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324879 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.324974 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.325120 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:54:30.325292 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.325620 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.325938 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.326250 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.326573 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.326893 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.327197 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.327520 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.327840 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.328178 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.328486 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.328822 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.329143 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.329453 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.329784 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.330085 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:54:30.330323 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:54:30.480465 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Registered counter for database nova_api Aug 17 19:54:30.485983 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Registered counter for database nova_api Aug 17 19:54:30.501411 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.506059 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.508709 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.512890 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.564160 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.context [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd013e9c-b514-4885-856a-d0c5ccdf15e9(cell1) {{(pid=105503) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:54:30.568071 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:54:30.568244 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.context [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd013e9c-b514-4885-856a-d0c5ccdf15e9(cell1) {{(pid=105504) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:54:30.568497 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:54:30.570087 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:54:30.570812 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:54:30.571244 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:54:30.572175 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:54:30.572579 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:54:30.573221 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:54:30.574176 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:54:30.574941 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:54:30.575298 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Registered counter for database nova_cell0 Aug 17 19:54:30.575433 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:54:30.577336 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:54:30.579358 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Registered counter for database nova_cell0 Aug 17 19:54:30.580713 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Registered counter for database nova_cell1 Aug 17 19:54:30.584843 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Registered counter for database nova_cell1 Aug 17 19:54:30.589520 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.591285 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.592007 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.595281 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.596581 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.598308 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.731470 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.733489 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.741749 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Registered counter for database nova_cell0 Aug 17 19:54:30.742900 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Registered counter for database nova_cell0 Aug 17 19:54:30.751692 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.755419 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:54:30.756252 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:30.760647 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:54:31.093085 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:54:31.097592 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:54:31.100342 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:54:31.104957 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:54:31.444196 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:54:31.448036 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:54:31.450254 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:54:31.454132 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-f23594cf-2b5a-4d42-be06-28a66c5b855b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:54:31.455532 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56282edfd9c0 pid: 105503 (default app) Aug 17 19:54:31.457640 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:54:31.458825 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001751 Aug 17 19:54:31.459232 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Aug 17 19:54:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:54:31.459384 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56282edfd9c0 pid: 105504 (default app) Aug 17 19:55:49.634268 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:49.635285 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 17 19:55:49.635674 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:49.649733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:49.650705 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell0:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:49.651558 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell1:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:49.653100 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:50.554215 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-c52046c0-196e-4067-bc4b-0402858cb05a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:50.586673 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-c52046c0-196e-4067-bc4b-0402858cb05a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.942098 Aug 17 19:55:50.587422 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 17 19:55:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:55:52.892038 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:52.893607 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-4d3b3da4-012a-4a7c-bc81-0003a833b975 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 17 19:55:52.894185 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:53.313520 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-461695e1-dff3-4052-8399-cdabc9c8880b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:53.335209 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:55:53.335209 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: warnings.warn(msg) Aug 17 19:55:53.367530 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-461695e1-dff3-4052-8399-cdabc9c8880b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.467991 Aug 17 19:55:53.369576 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:55:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:55:53.381862 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:53.382660 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:53.383882 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell1:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:53.384861 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:53.590166 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-daaa9030-3a42-4858-a16b-1013588c3d9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:53.595991 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:55:53.595991 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 19:55:53.654073 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-daaa9030-3a42-4858-a16b-1013588c3d9d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277315 Aug 17 19:55:53.654659 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 17 19:55:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:56.002222 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-461695e1-dff3-4052-8399-cdabc9c8880b admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:56.003246 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-461695e1-dff3-4052-8399-cdabc9c8880b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 17 19:55:56.003643 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:56.669211 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-74ab7a5c-1201-491a-af0a-b40f8027d584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:56.688468 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:55:56.688468 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 19:55:56.709260 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-74ab7a5c-1201-491a-af0a-b40f8027d584 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699333 Aug 17 19:55:56.710148 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:55:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:55:56.722407 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-03d2b79d-1ef4-4023-ad18-efb9c8239971 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:56.725293 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:55:56.725293 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: warnings.warn(msg) Aug 17 19:55:56.760254 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-03d2b79d-1ef4-4023-ad18-efb9c8239971 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041641 Aug 17 19:55:56.761209 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 17 19:55:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:59.111444 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-74ab7a5c-1201-491a-af0a-b40f8027d584 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:59.112444 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-74ab7a5c-1201-491a-af0a-b40f8027d584 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Aug 17 19:55:59.113034 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:59.515493 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-09431abc-f9e9-4ccb-8069-38c0f9ed9c2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:59.535022 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-09431abc-f9e9-4ccb-8069-38c0f9ed9c2c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415391 Aug 17 19:55:59.535788 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:55:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:55:59.548556 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-bd08bb09-d1ca-4a13-a11d-0793360c733e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:59.574638 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-bd08bb09-d1ca-4a13-a11d-0793360c733e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030221 Aug 17 19:55:59.575220 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 17 19:55:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:01.915020 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-09431abc-f9e9-4ccb-8069-38c0f9ed9c2c admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:01.916024 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-09431abc-f9e9-4ccb-8069-38c0f9ed9c2c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 17 19:56:01.916497 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:02.370914 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-db5bed40-f238-4990-993e-e3cdc5f67ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:02.392017 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-db5bed40-f238-4990-993e-e3cdc5f67ede admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469197 Aug 17 19:56:02.392660 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:02.404760 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-539e680d-ecfa-4f4f-9ec0-b0db42a410ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:02.431861 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-539e680d-ecfa-4f4f-9ec0-b0db42a410ba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030956 Aug 17 19:56:02.432531 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 17 19:56:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:56:04.762951 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-db5bed40-f238-4990-993e-e3cdc5f67ede admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:04.763833 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-db5bed40-f238-4990-993e-e3cdc5f67ede admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 17 19:56:04.764262 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:05.186928 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:05.206682 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435281 Aug 17 19:56:05.207431 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:05.219488 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-afe5f0cd-fbea-4ec0-a155-f371748dd804 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:05.244944 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-afe5f0cd-fbea-4ec0-a155-f371748dd804 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029159 Aug 17 19:56:05.245529 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 17 19:56:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:07.759433 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:07.760790 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Aug 17 19:56:07.761263 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:08.181799 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-68409197-fa27-4c00-b4ab-a3ceaca1659f admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:08.206329 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-68409197-fa27-4c00-b4ab-a3ceaca1659f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437644 Aug 17 19:56:08.206894 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 17 19:56:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:56:11.065844 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:11.067123 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-052950d0-2903-46ed-a94f-5482fef18b5d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 17 19:56:11.067591 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:11.495484 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-5faba946-f1dc-4618-a1be-ab0b9574c88f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "name": "m1.tiny"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:11.515199 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-5faba946-f1dc-4618-a1be-ab0b9574c88f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439888 Aug 17 19:56:11.515740 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:11.527810 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-0511254c-0bc8-4fab-b10d-5920687c6b7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:11.554753 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-0511254c-0bc8-4fab-b10d-5920687c6b7f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030640 Aug 17 19:56:11.555460 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 17 19:56:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:13.876379 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-5faba946-f1dc-4618-a1be-ab0b9574c88f admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:13.877416 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-5faba946-f1dc-4618-a1be-ab0b9574c88f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 17 19:56:13.877860 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:14.279417 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6c6dc34f-3039-4ed1-a40c-ac50361dec52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:14.299908 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6c6dc34f-3039-4ed1-a40c-ac50361dec52 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415665 Aug 17 19:56:14.300462 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:14.312652 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-9a0d6686-3871-4688-8809-3504cf358db9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:14.337382 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-9a0d6686-3871-4688-8809-3504cf358db9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028395 Aug 17 19:56:14.337998 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 17 19:56:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:16.690864 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6c6dc34f-3039-4ed1-a40c-ac50361dec52 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:16.691815 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6c6dc34f-3039-4ed1-a40c-ac50361dec52 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Aug 17 19:56:16.692407 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:56:17.128603 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-16d2c3da-9571-4f83-82c5-b773f8ada464 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:17.149025 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-16d2c3da-9571-4f83-82c5-b773f8ada464 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.450394 Aug 17 19:56:17.149721 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:17.162555 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-424a4347-596b-403f-b405-835ecb9e927d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:17.189561 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-424a4347-596b-403f-b405-835ecb9e927d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030954 Aug 17 19:56:17.190199 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 17 19:56:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:19.564991 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-16d2c3da-9571-4f83-82c5-b773f8ada464 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:19.566234 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-16d2c3da-9571-4f83-82c5-b773f8ada464 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Aug 17 19:56:19.567287 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:20.109961 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-aecbfd8b-d674-4c0c-ad90-ff94902a6bdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:20.120453 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:56:20.141061 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-aecbfd8b-d674-4c0c-ad90-ff94902a6bdc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.564631 Aug 17 19:56:20.141061 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:20.154734 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d6fa0166-7790-44bf-b885-28f139e462a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:20.185507 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d6fa0166-7790-44bf-b885-28f139e462a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035987 Aug 17 19:56:20.186805 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 17 19:56:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:22.516708 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-aecbfd8b-d674-4c0c-ad90-ff94902a6bdc admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:22.517760 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-aecbfd8b-d674-4c0c-ad90-ff94902a6bdc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 17 19:56:22.518437 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:22.966924 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:22.990197 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465621 Aug 17 19:56:22.991033 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 17 19:56:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 19:56:23.004940 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-f43220a7-74d4-4c86-8291-784b95445ffa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:23.030955 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-f43220a7-74d4-4c86-8291-784b95445ffa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031496 Aug 17 19:56:23.031900 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 17 19:56:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:56:41.074370 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:41.075278 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 17 19:56:41.075670 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:41.086528 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:56:41.510814 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-eb477e56-6249-4213-a7e1-5984221d5582 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:41.528960 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-eb477e56-6249-4213-a7e1-5984221d5582 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447086 Aug 17 19:56:41.529496 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 17 19:56:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:42.608289 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:42.609300 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d4805610-f487-425b-b533-eed5d16048c8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 17 19:56:42.609737 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:43.168197 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-72870835-370e-4eb6-b16e-182441631a54 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:43.174299 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-72870835-370e-4eb6-b16e-182441631a54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-72870835-370e-4eb6-b16e-182441631a54 admin admin] Request method failure captured: Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept: application/json Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Connection: keep-alive Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Content-Length: 0 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Host: 10.222.0.18 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABi_Uf6PZ78YcDwFpkvN04CxW6QRwr0Mx0N_Rgxeh8IKVnmGZBUiRdHzoajbBWtUAR7NjoPDgJsoirpL3Wj-Pv02D6ZrU__-VDzgd-bKlpMr5s0cUdGg0DreV2D_AY-Ri82ffOReqheCS5iL_YXk8VoA315XDnZcH2wEsK32E2LFT5NZ5g Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Role: reader,admin,member Aug 17 19:56:43.177523 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Roles: reader,admin,member Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant: admin Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User: admin Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Name: admin Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: method: > Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: exception: Flavor 42 could not be found. Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: action_args: {'id': '42'} Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:43.178971 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:43.179813 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.181314 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-72870835-370e-4eb6-b16e-182441631a54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:43.182699 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-72870835-370e-4eb6-b16e-182441631a54 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.431497 Aug 17 19:56:43.182699 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 17 19:56:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:56:43.188801 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-df065f2e-889e-45ef-8636-4b9de57fe125 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:43.193006 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:56:43.212750 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-df065f2e-889e-45ef-8636-4b9de57fe125 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027493 Aug 17 19:56:43.213293 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:43.223110 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-f555dd78-9ccc-45ee-8de2-1340dc47a8b8 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:43.247027 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-f555dd78-9ccc-45ee-8de2-1340dc47a8b8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027556 Aug 17 19:56:43.247554 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:43.256883 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-793561b3-73f0-4a3e-8117-4073fd26d322 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:43.263586 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-793561b3-73f0-4a3e-8117-4073fd26d322 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-793561b3-73f0-4a3e-8117-4073fd26d322 admin admin] Request method failure captured: Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Host: 10.222.0.18 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_Uf6PZ78YcDwFpkvN04CxW6QRwr0Mx0N_Rgxeh8IKVnmGZBUiRdHzoajbBWtUAR7NjoPDgJsoirpL3Wj-Pv02D6ZrU__-VDzgd-bKlpMr5s0cUdGg0DreV2D_AY-Ri82ffOReqheCS5iL_YXk8VoA315XDnZcH2wEsK32E2LFT5NZ5g Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Role: reader,admin,member Aug 17 19:56:43.266852 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Roles: reader,admin,member Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User: admin Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: method: > Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: exception: Flavor 42 could not be found. Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: action_args: {'id': '42'} Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:43.268362 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:43.269318 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:43.270615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-793561b3-73f0-4a3e-8117-4073fd26d322 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:43.271806 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-793561b3-73f0-4a3e-8117-4073fd26d322 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014868 Aug 17 19:56:43.271806 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 17 19:56:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 19:56:44.241863 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-f555dd78-9ccc-45ee-8de2-1340dc47a8b8 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:44.242931 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-f555dd78-9ccc-45ee-8de2-1340dc47a8b8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 17 19:56:44.243360 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:44.795019 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-41c98642-ebbc-42aa-8a79-1f92f4abf634 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:44.800891 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-41c98642-ebbc-42aa-8a79-1f92f4abf634 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-41c98642-ebbc-42aa-8a79-1f92f4abf634 admin admin] Request method failure captured: Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Host: 10.222.0.18 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_Uf8Zt7anUD6JUcNJnSHgdiJHAtYe6wN0HtQ_xng_7LJL8h4_KgfwsqoWvBlA1rb16-DQa1tgbKEBTgVeJnroZL62ulv8IoC0aorn_fCuLoZzRXoBu1V0UPZyTiKGjJ1zXC0YUVORIw5I9z3wP5UfcFprQUnihrsE867qzX7PIvIkXY Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Role: reader,admin,member Aug 17 19:56:44.802420 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Roles: reader,admin,member Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User: admin Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: method: > Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: exception: Flavor 84 could not be found. Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: action_args: {'id': '84'} Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:44.803902 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:44.804756 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.805952 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-41c98642-ebbc-42aa-8a79-1f92f4abf634 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:44.807270 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-41c98642-ebbc-42aa-8a79-1f92f4abf634 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.423302 Aug 17 19:56:44.807270 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 17 19:56:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:56:44.813773 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-60569677-653a-4cba-b06a-18ff7f706c92 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:44.828491 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-60569677-653a-4cba-b06a-18ff7f706c92 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018295 Aug 17 19:56:44.828970 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:44.838570 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-a84f805a-9447-4441-957b-583e2e5dfb0b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:44.853934 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-a84f805a-9447-4441-957b-583e2e5dfb0b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018829 Aug 17 19:56:44.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:44.869226 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8ba886a9-4063-405b-bf66-a181e69bc25a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:44.874981 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-8ba886a9-4063-405b-bf66-a181e69bc25a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8ba886a9-4063-405b-bf66-a181e69bc25a admin admin] Request method failure captured: Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept: application/json Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Connection: keep-alive Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Content-Length: 0 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Host: 10.222.0.18 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABi_Uf8Zt7anUD6JUcNJnSHgdiJHAtYe6wN0HtQ_xng_7LJL8h4_KgfwsqoWvBlA1rb16-DQa1tgbKEBTgVeJnroZL62ulv8IoC0aorn_fCuLoZzRXoBu1V0UPZyTiKGjJ1zXC0YUVORIw5I9z3wP5UfcFprQUnihrsE867qzX7PIvIkXY Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Role: reader,admin,member Aug 17 19:56:44.876494 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Roles: reader,admin,member Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant: admin Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User: admin Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Name: admin Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: method: > Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: exception: Flavor 84 could not be found. Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: action_args: {'id': '84'} Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:44.877994 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:44.878869 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:44.880094 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8ba886a9-4063-405b-bf66-a181e69bc25a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:44.881092 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8ba886a9-4063-405b-bf66-a181e69bc25a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014350 Aug 17 19:56:44.881092 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 17 19:56:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:56:45.863962 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-a84f805a-9447-4441-957b-583e2e5dfb0b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:45.864964 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-a84f805a-9447-4441-957b-583e2e5dfb0b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 17 19:56:45.865356 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:46.427293 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-abcf24a5-cbd2-41f3-8056-eff0f15c6f14 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:46.433557 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-abcf24a5-cbd2-41f3-8056-eff0f15c6f14 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-abcf24a5-cbd2-41f3-8056-eff0f15c6f14 admin admin] Request method failure captured: Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept: application/json Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Connection: keep-alive Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Content-Length: 0 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Host: 10.222.0.18 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABi_Uf9n-5-C22Sr-ab4x3Cl2pyAidoQN3_IugJ0FZjXxY7quTZ15VpBfsIG48Pxtc9Dx47Mks4qyRfxyDS05KmVgytPhVVFWCUESF88Y2aQc4y8uDYgLh1ispH4ssZKI0uzofCoHauIpBriOneVguh4hWz9XlldFcoAKOfDO1B3wsfnBg Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Role: reader,admin,member Aug 17 19:56:46.435133 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Roles: reader,admin,member Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant: admin Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User: admin Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: X-User-Name: admin Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: method: > Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: exception: Flavor 451 could not be found. Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: action_args: {'id': '451'} Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:46.436693 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:46.437733 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.439049 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-abcf24a5-cbd2-41f3-8056-eff0f15c6f14 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:46.440348 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-abcf24a5-cbd2-41f3-8056-eff0f15c6f14 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433505 Aug 17 19:56:46.440348 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 19:56:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:56:46.446700 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fca17668-b207-4377-a37b-66c1ba74121a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:46.461900 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fca17668-b207-4377-a37b-66c1ba74121a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018758 Aug 17 19:56:46.462421 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:46.472012 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:46.487037 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018554 Aug 17 19:56:46.487546 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 17 19:56:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:56:46.496760 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-2aa3b52f-9dbd-4316-ab53-ba55248deb2d admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:46.502615 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-2aa3b52f-9dbd-4316-ab53-ba55248deb2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-2aa3b52f-9dbd-4316-ab53-ba55248deb2d admin admin] Request method failure captured: Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Host: 10.222.0.18 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_Uf9n-5-C22Sr-ab4x3Cl2pyAidoQN3_IugJ0FZjXxY7quTZ15VpBfsIG48Pxtc9Dx47Mks4qyRfxyDS05KmVgytPhVVFWCUESF88Y2aQc4y8uDYgLh1ispH4ssZKI0uzofCoHauIpBriOneVguh4hWz9XlldFcoAKOfDO1B3wsfnBg Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Role: reader,admin,member Aug 17 19:56:46.504108 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Roles: reader,admin,member Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79e7870848b34ea38cb8567a241b0ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 79e7870848b34ea38cb8567a241b0ce4 Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User: admin Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Id: 3a9bd68510704bb0a6eea1e00548849b Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: method: > Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: exception: Flavor 451 could not be found. Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: action_args: {'id': '451'} Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:56:46.505521 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:46.507403 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 17 19:56:46.508657 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-2aa3b52f-9dbd-4316-ab53-ba55248deb2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:56:46.509961 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-2aa3b52f-9dbd-4316-ab53-ba55248deb2d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012258 Aug 17 19:56:46.509961 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 19:56:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:56:47.493221 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:47.494274 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 17 19:56:47.494632 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:48.042363 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d2d0b68b-b544-46bb-ab36-e82e67366940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:48.065234 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d2d0b68b-b544-46bb-ab36-e82e67366940 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.434470 Aug 17 19:56:48.065821 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 17 19:56:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:49.076875 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:49.077907 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 17 19:56:49.078322 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:49.638469 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-90520013-fa97-4c54-a26b-b72b04f03b59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:49.661405 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-90520013-fa97-4c54-a26b-b72b04f03b59 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.444391 Aug 17 19:56:49.661983 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 17 19:56:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:50.631720 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:50.632742 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 17 19:56:50.633130 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:51.193908 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8e3aa329-8e02-4f60-b7c2-e034168cb91e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:51.217579 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8e3aa329-8e02-4f60-b7c2-e034168cb91e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448034 Aug 17 19:56:51.218159 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 17 19:56:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:52.198743 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:52.199768 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 17 19:56:52.200154 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:52.760973 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-aad26972-82b4-4ae1-bf1d-e425df1e2325 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:56:52.782879 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-aad26972-82b4-4ae1-bf1d-e425df1e2325 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.445498 Aug 17 19:56:52.783418 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 17 19:56:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:56:53.751584 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:53.752849 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 17 19:56:53.753373 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 19:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:56:54.311731 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-0ceefe3a-796a-4ac0-9fee-3507469a27ad admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:56:54.332567 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-0ceefe3a-796a-4ac0-9fee-3507469a27ad admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.441333 Aug 17 19:56:54.333117 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Aug 17 19:56:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:57:47.791380 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:47.792660 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-2217be84-a311-4da7-989e-e80ecd26346f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 17 19:57:47.793242 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 17 19:57:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:57:47.808865 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:48.211880 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-6aea3d29-de8d-4cfa-a8f7-d5c87c08ee4d admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:48.232626 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-6aea3d29-de8d-4cfa-a8f7-d5c87c08ee4d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429380 Aug 17 19:57:48.233178 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 17 19:57:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:57:48.264106 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=14 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:48.268015 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-e8f4e10c-561d-463c-ae51-9b6e628315cd admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:48.276379 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-e8f4e10c-561d-463c-ae51-9b6e628315cd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013677 Aug 17 19:57:48.276900 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 17 19:57:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:48.288541 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-05f7b772-a25a-43ee-a507-757d97766556 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:48.297130 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-05f7b772-a25a-43ee-a507-757d97766556 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012158 Aug 17 19:57:48.297636 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 17 19:57:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:48.309051 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:48.316901 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011354 Aug 17 19:57:48.317411 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 17 19:57:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:57:48.328648 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-52c56ce7-f14d-41aa-af23-d16aa3641d01 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:48.336381 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-52c56ce7-f14d-41aa-af23-d16aa3641d01 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011188 Aug 17 19:57:48.336904 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 17 19:57:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:49.208397 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:00:49.209674 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Aug 17 20:00:49.210169 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 20:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:00:49.347100 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=6 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.527564 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:00:49.529903 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:00:49.529903 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 20:00:49.531012 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:00:49.531472 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:00:49.531915 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:00:49.532614 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:00:49.533043 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:00:49.533443 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:00:49.571772 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-dddc83cf-2096-4311-be85-c843869ce796 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.225673 Aug 17 20:00:49.572643 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 20:00:49 2022] GET /compute/v2.1/os-services => generated 794 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:00:50.405889 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:00:50.406948 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003560 Aug 17 20:00:50.407348 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 20:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:00:50.601339 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:00:50.603681 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:00:50.603681 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 20:00:50.604788 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:00:50.605258 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:00:50.605706 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:00:50.606415 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:00:50.606850 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:00:50.607259 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:00:50.626358 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-9d8e3bd8-f47d-4d69-9fd6-b943d7831f62 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.082213 Aug 17 20:00:50.626897 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 20:00:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:01.884538 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:01:01.885563 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 17 20:01:01.885977 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 20:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:01:02.030152 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=4 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.030874 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell1:SELECT=4 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.031509 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=8 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.087061 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:01:02.089495 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:01:02.089495 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 20:01:02.090529 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:01:02.090991 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:01:02.091404 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:01:02.092094 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:01:02.092526 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:01:02.092926 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:01:02.117286 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-031ed9cc-7615-4578-b6b2-07ce27747662 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.091647 Aug 17 20:01:02.117855 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 20:01:02 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:01:02.948203 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:01:02.949291 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a23c2626-4d3c-42a6-912c-5d803a0bab6a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 17 20:01:02.949692 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 17 20:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:01:03.150843 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:01:03.153128 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:01:03.153128 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 17 20:01:03.154248 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:01:03.154709 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:01:03.155119 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:01:03.155815 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:01:03.156248 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:01:03.156670 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:01:03.178452 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-efa8774c-cc95-4bc2-9891-f2d6b8cdaa6c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090650 Aug 17 20:01:03.178995 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 17 20:01:03 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:02:01.770443 dv-cinder-820027-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 20:02:01.770983 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: Wed Aug 17 20:02:01 2022 - graceful shutdown triggered... Aug 17 20:02:01.771434 dv-cinder-820027-19-iscsi devstack@n-api.service[105504]: Gracefully killing worker 2 (pid: 105504)... Aug 17 20:02:01.771779 dv-cinder-820027-19-iscsi devstack@n-api.service[105503]: Gracefully killing worker 1 (pid: 105503)... Aug 17 20:02:02.771691 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: worker 1 buried after 1 seconds Aug 17 20:02:02.771691 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: worker 2 buried after 1 seconds Aug 17 20:02:02.771691 dv-cinder-820027-19-iscsi devstack@n-api.service[105502]: goodbye to uWSGI. Aug 17 20:02:02.774246 dv-cinder-820027-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 20:02:02.775123 dv-cinder-820027-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 20:02:02.779128 dv-cinder-820027-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 20:02:02.790749 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 20:02:02 2022] *** Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: nodename: dv-cinder-820027-19-iscsi Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: machine: x86_64 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: clock source: unix Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: pcre jit disabled Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: detected number of CPU cores: 4 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: current working directory: / Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: detected binary path: /usr/bin/uwsgi-core Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: your processes number limit is 47680 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: your memory page size is 4096 bytes Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: detected max file descriptor number: 2048 Aug 17 20:02:02.792811 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: lock engine: pthread robust mutexes Aug 17 20:02:02.793998 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: thunder lock: enabled Aug 17 20:02:02.793998 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 20:02:02.793998 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 20:02:02.839254 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: Python main interpreter initialized at 0x55a2b1e719c0 Aug 17 20:02:02.839254 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: python threads support enabled Aug 17 20:02:02.839254 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: your server socket listen backlog is limited to 100 connections Aug 17 20:02:02.839254 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: your mercy for graceful operations on workers is 90 seconds Aug 17 20:02:02.839763 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 20:02:02.839763 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: *** Operational MODE: preforking *** Aug 17 20:02:02.839918 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: *** uWSGI is running in multiple interpreter mode *** Aug 17 20:02:02.839918 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: spawned uWSGI master process (pid: 120798) Aug 17 20:02:02.840142 dv-cinder-820027-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 20:02:02.842487 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: spawned uWSGI worker 1 (pid: 120818, cores: 1) Aug 17 20:02:02.842487 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: spawned uWSGI worker 2 (pid: 120819, cores: 1) Aug 17 20:02:02.842487 dv-cinder-820027-19-iscsi devstack@n-api.service[120798]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 20:02:03.491386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:02:03.501939 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:02:04.643689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:02:04.643689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: from cryptography.utils import int_from_bytes Aug 17 20:02:04.644487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:02:04.644487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: from cryptography.utils import int_from_bytes Aug 17 20:02:04.662201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:02:04.662201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: from cryptography.utils import int_from_bytes Aug 17 20:02:04.662804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:02:04.662804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: from cryptography.utils import int_from_bytes Aug 17 20:02:06.967393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:02:06.968003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:02:06.968297 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:02:06.968510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:02:06.968769 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:02:06.969190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.969517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.969889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.970183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.970498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.970812 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.971145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.971487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.971820 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.972061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.972398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.972711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-19-iscsi {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.973017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.973330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.973678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.973997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.974303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.974627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.974933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.975429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.976876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.976876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.976876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.976876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.977192 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.977475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.977779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.978084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.978407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.978724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.979132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-19-iscsi {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.979446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.979750 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.980068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.980526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.980835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.981149 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.981470 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.981841 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.982154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.982490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.982808 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.983124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.983432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.983738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.984064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.984378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.984699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.985003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.985295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.985584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.985895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.986216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.986539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.986863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.987113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.987365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.987686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.988833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.988833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.988833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.989285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.989285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.989625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.989776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.990093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.990407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.990714 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.991048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.991369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.991675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.991996 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.992395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.992655 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.992951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.993290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.993634 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.993948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.994260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.994585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.994898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.995203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.995514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.995862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.996203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.996509 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.996762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.997062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.997366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.997712 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.998022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.998326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.998630 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.998929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.999235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.999535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:06.999839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.000146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.000456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.000753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.001268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.001382 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.001679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.001999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.002340 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.002648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.002942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.003247 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.003554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.003874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.004181 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.004488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.004809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.005114 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.005482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.005837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.006144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.006449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.006768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.007066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.007376 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.007693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.008001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.008308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.008614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.008920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.009224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.009528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.009852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.010156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.010459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.010778 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.011100 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.011373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:02:07.011864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.011961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:02:07.012056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.012056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.012239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:02:07.012364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.012568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:02:07.012705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.012819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:02:07.013040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.013201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.013386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.013524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.013729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.013870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.014068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.014168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.014407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.014595 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.014754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.014909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.015030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.015120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.015338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.015459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.015666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.015806 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.015983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.016145 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.016282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.016425 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.016596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.016741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-19-iscsi {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.016915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.017061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.017221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.017366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.017528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.017654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.017864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.017967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.018164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.018263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.018482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.018578 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.018782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.018873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.019097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.019282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.019428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.019585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.019752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.019887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.020064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.020190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.020403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.020521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.020749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.020851 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.021061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.021151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.021386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.021576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.023726 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.023917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.024074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.024178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.024265 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.024360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.024447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.024530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-19-iscsi {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.024622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.024702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.024843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.024939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025200 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025791 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.025864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.025988 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.026056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.026133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.026217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.026295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.026367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.026436 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028220 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028309 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.028925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.028995 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.029065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.029151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.029223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.029293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.029369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.029463 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.029556 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.029651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.029732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.029810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.030660 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.030773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.030850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.030930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.030930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.031063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.031133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.031210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.031290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.031361 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.032329 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.032440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.032535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.032615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.032697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.032769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.032878 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.032971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.032971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.033133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.033133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.033298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.033389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.033474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.033603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.033700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.034162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.034274 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.034360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.034445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.034529 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.034795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.034906 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.035112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.035296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.035444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.035588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.035744 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.035907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.036003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.036152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.036351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.036456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.036634 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.036782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.036944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.037095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.037255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.037456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.037614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.037786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.037950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.038194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.038307 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.038554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.038666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.038861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.038954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.039184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.039297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.039488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.039591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.039805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.040150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.040250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.040336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.040428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.040586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.040678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.040899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.040992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.041200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.041292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.041503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.041672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.041841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.041950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.042145 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.042238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.042447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.042546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.042799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.042903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.043096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.043197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.043399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.043490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.043702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.043803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.044009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.044113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.044312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.044414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.044615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.044705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.044914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.045017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.045215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.045305 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.045516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.045635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.045837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.045938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.046496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.046591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.046858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.046947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.047206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.047304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.047520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.047618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.047826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.047917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.048131 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.048231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.048447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.048546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.048752 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.048849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.049056 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.049146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.049369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.049472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.049696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.049787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.049999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.050088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.050309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.050413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.050612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.050710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.050914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.051004 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.051223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.051322 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.051518 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.051616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.051820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.051917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.052129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.052220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.052430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.052534 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.052731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.052831 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.053033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.053130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.053331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.053421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.053653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.053761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.053954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.054045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.054254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.054391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.054553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.054642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.054850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.054988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.055164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.055256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.055479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.055608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.055786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.055878 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.056088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.056187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.056390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.056489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.056703 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:02:07.056803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.057780 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058354 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058465 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058671 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.058985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.059903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.060843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.061632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.061822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.061978 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062121 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062271 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.062870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.063872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064600 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064757 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.064898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.065831 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.066147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.066451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.066553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.066796 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.067110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.067204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.067422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.067646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.067738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.068991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.069094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.069301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.069399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.069722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.069828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.070983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.071222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.071408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.071554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.071694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.071895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.072962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.073941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.074217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.074433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.074562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.074770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.074908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.075088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.075374 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.075510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.075722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.075863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.076044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.076179 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.076380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.076579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.076717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077329 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.077972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.078874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079181 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079484 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.079927 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080241 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.080848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.081981 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.082918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.083964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.084919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085106 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085236 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.085896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086078 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086627 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.086951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.087899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088822 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.088951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089601 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.089916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090703 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.090830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091615 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.091927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.092963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093270 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.093968 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.094971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.095322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.095457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.095696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.095832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.095943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.096059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.096176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.096441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.096757 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.096928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.097238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.097402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.097575 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.097737 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.097882 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.098963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.099857 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.100935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101229 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.101943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102595 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102744 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.102925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103443 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.103818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104458 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104606 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.104992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.105165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.105393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.105572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.105721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.105872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.106880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107629 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.107919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.108814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.109104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.109355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.109717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.109863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.109863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.110300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.110446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.110591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.110741 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.110891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111192 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.111928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.112873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113056 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.113869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114741 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.114883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.115152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.115408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.115576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.115743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.115931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116548 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.116710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.117222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.117373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.117616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.117782 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.117782 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118621 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118840 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.118992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119431 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.119869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.120929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.121984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122145 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.122883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.123911 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.124955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125780 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.125931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126087 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126087 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.126971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127543 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.127846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.128867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.129940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.130898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131500 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131642 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131791 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.131945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132242 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.132974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.133902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134044 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134338 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.134921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135470 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135778 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.135920 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136549 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.136998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.137926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.138970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.139989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.140239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.140384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.140569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.140808 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141168 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.141810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.142965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143106 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.143914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144208 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144781 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.144921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.145978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146121 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.146854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147596 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.147887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148183 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148329 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148634 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.148925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149703 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.149987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.150870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151769 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.151918 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152731 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.152886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153185 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.153975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.154972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155253 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.155986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.156962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.157873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158025 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.158904 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159354 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.159951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160536 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.160989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161610 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161766 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.161916 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162513 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.162961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163549 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.163986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.164867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165165 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165620 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.165926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166335 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166484 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.166935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167078 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167539 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.167870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168171 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.168916 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.169986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170438 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.170727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.171464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.171612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.171776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.172859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173167 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.173923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174359 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174805 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.174956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.175226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.175374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.175524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.175680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.175831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.176918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.177975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.178998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.179874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180501 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180806 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.180956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.181910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.182953 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183650 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.183934 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.184901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.185854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.186891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.187039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.187194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.187451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.187666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.187858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188541 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.188848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.189816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.190879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191200 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.191959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192723 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.192889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193038 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.193881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.194877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195657 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.195970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196118 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196265 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.196909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.197862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198018 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.198979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.199888 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200656 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.200978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.201940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.202891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203500 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.203814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204242 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.204867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.205935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206085 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.206868 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207165 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.207926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208535 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.208989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209631 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209783 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.209930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.210884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211655 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.211820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212610 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.212928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213078 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.213873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214023 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214171 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.214715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215613 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.215909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.216872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.217302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.217302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.217667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.217667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.217962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.218996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.219945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.220984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221818 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.221982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.222926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.223871 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224100 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.224873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.225986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:02:07.226137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.226137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.226137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.226137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.226713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.226713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.227007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.227202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.227569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.227821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.228167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.228516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.228829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.229138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.229458 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.229793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.230102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.230529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.230745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.231063 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.231369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.231682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.231987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.232301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.232608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.232918 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.233224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.234694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.234694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.234694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.234694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.235342 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.235342 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.235635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.235864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.236224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.236697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.237220 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.237632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.237924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.238272 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.238608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.238920 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.239230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.239546 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.239878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.240192 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.240510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.240824 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.241136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.241449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.241806 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.242122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.242435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.242750 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.243062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.243372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.243682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.244555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.244555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.245170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.245170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.245480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.245677 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.245971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.246296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.246613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.246929 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.247244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.247557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.247877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.248216 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.248536 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.248851 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.249294 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.249662 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.250186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.250379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.250614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.250937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.251260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.251575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.251901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.252214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.252544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.252890 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.253220 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.253607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.253880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.254236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.254878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.254878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.255468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.255468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.255778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.255986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.256297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.256605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.256913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.257220 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.257525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.257925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.258235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.258539 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.258842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.259146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.259455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.259760 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.260070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.260381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.260670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.261021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.261273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.261634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.261983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.262322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.262644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.262969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.263286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.263610 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.263921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.264324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.264959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.264959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.265623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.265623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.266023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.266173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.266470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.266783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.267093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.267404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.267740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.268067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.268375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.268702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.269081 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.269418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.269765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.270081 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.270474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.270729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.271166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.271358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.271671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.271985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.272311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.272602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.272916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.273235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.273700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.273923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.274251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.274571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.275201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.275201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.275826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.275985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.276203 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.276532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.276848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.277355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.277692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:02:07.277999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:02:07.379403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Registered counter for database nova_api Aug 17 20:02:07.400257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.407162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.438820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO dbcounter [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Registered counter for database nova_api Aug 17 20:02:07.458998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_db.sqlalchemy.engines [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.464148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.context [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd013e9c-b514-4885-856a-d0c5ccdf15e9(cell1) {{(pid=120818) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:02:07.466128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writer thread running {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.468411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:02:07.468810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:02:07.471437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:02:07.472212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:02:07.472654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:02:07.474679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:02:07.476730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Registered counter for database nova_cell0 Aug 17 20:02:07.480945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Registered counter for database nova_cell1 Aug 17 20:02:07.488435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.490326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.495865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.498420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.523832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.context [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd013e9c-b514-4885-856a-d0c5ccdf15e9(cell1) {{(pid=120819) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:02:07.528355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:02:07.528826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:02:07.531690 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:02:07.532446 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:02:07.532886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:02:07.534881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:02:07.536900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO dbcounter [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Registered counter for database nova_cell0 Aug 17 20:02:07.541106 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO dbcounter [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Registered counter for database nova_cell1 Aug 17 20:02:07.549037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_db.sqlalchemy.engines [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.551401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_db.sqlalchemy.engines [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.558808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writer thread running {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.560117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writer thread running {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.643286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Registered counter for database nova_cell0 Aug 17 20:02:07.650068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.654941 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.702711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO dbcounter [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Registered counter for database nova_cell0 Aug 17 20:02:07.709823 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_db.sqlalchemy.engines [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:02:07.716579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writer thread running {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:02:07.972720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:02:07.978580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:02:08.048590 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: WARNING keystonemiddleware.auth_token [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:02:08.055941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: WARNING keystonemiddleware.auth_token [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:02:08.329263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:02:08.335681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-42b38ace-995c-496c-90aa-433502b9c3d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:02:08.342244 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2b1e719c0 pid: 120818 (default app) Aug 17 20:02:08.411092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: WARNING keystonemiddleware.auth_token [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:02:08.417166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: WARNING keystonemiddleware.auth_token [None req-b89fdee3-f33b-43e9-bbdd-f851acaeb664 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:02:08.423843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2b1e719c0 pid: 120819 (default app) Aug 17 20:02:43.550720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:43.552795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:43.553804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:43.555313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.145916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.147874 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.149990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.151396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.969369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-afd7b133-229b-4e61-9695-5ce2acfb30f4 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Action: 'create', calling method: .version_select at 0x7faaaebab280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-153399577", "metadata": {"Type": "work"}}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:45.520460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0b34cace-137c-4457-83f1-f774766e93dc tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Action: 'create', calling method: .version_select at 0x7faaaebab280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-950681255", "metadata": {"Type": "work"}}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0b34cace-137c-4457-83f1-f774766e93dc tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 121 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:45.536721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-950681255", "metadata": {"Type": "work"}}} Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:45.538480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-950681255', 'metadata': {'Type': 'work'}}}} Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:45.539417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:02:45.540901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:02:45.542154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:02:45.542154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.546088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0b34cace-137c-4457-83f1-f774766e93dc tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:45.549445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0b34cace-137c-4457-83f1-f774766e93dc tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.420764 Aug 17 20:02:45.550370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 17 20:02:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1424 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:02:45.562578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-44ff92f6-6569-471c-8246-357061624497 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Action: 'create', calling method: .version_select at 0x7faaaebabf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-635823278", "metadata": {"Type": "work"}}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-44ff92f6-6569-471c-8246-357061624497 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 119 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:45.570971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-635823278", "metadata": {"Type": "work"}}} Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:45.572671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-635823278', 'metadata': {'Type': 'work'}}}} Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi '0' Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:45.574218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:02:45.575997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:02:45.577306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:02:45.577306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.580376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-44ff92f6-6569-471c-8246-357061624497 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:45.581449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-44ff92f6-6569-471c-8246-357061624497 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024965 Aug 17 20:02:45.582529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 17 20:02:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:02:45.594663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b8ffcfa5-0822-465f-af95-9db1a4510885 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Action: 'create', calling method: .version_select at 0x7faaaeab6ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-673697914", "metadata": {"Type": "work"}}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b8ffcfa5-0822-465f-af95-9db1a4510885 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 118 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:45.599741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-673697914", "metadata": {"Type": "work"}}} Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:45.601331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-673697914', 'metadata': {'Type': 'work'}}}} Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi '' Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:45.602345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:02:45.603872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:02:45.605115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:02:45.605115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:45.608509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b8ffcfa5-0822-465f-af95-9db1a4510885 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:45.611460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b8ffcfa5-0822-465f-af95-9db1a4510885 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023833 Aug 17 20:02:45.615663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 17 20:02:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:02:45.625498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91ecd0e6-2dd3-4f1b-845a-b7bfc5c251b9 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Calling method '.version_select at 0x7faaaeab6b80>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:46.425554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-91ecd0e6-2dd3-4f1b-845a-b7bfc5c251b9 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] HTTP exception thrown: Volume tempest-invalid-651517409 could not be found. Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91ecd0e6-2dd3-4f1b-845a-b7bfc5c251b9 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-651517409 HTTP/1.1 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:46.430211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume tempest-invalid-651517409 could not be found. Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'tempest-invalid-651517409'} Aug 17 20:02:46.432128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-651517409 could not be found. (HTTP 404) (Request-ID: req-194a4460-f57b-4efd-b2bc-b264d3fe4d10) Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.432974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:02:46.436845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-651517409 could not be found. Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:02:46.440388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-651517409 could not be found. Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-651517409 could not be found. Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91ecd0e6-2dd3-4f1b-845a-b7bfc5c251b9 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 404 to user: Volume tempest-invalid-651517409 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91ecd0e6-2dd3-4f1b-845a-b7bfc5c251b9 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-651517409" status: 404 len: 98 microversion: 2.1 time: 0.811233 Aug 17 20:02:46.443334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Aug 17 20:02:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-651517409 => generated 98 bytes in 812 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 17 20:02:46.449170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8c6b21b8-7743-4fc2-8c32-8c8a771c546e tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006394 Aug 17 20:02:46.449170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 17 20:02:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 20:02:46.459477 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3c4ec95f-3a94-44e9-a53a-ad77d263a375 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005583 Aug 17 20:02:46.460471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Aug 17 20:02:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 20:02:46.481495 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3f709812-6efb-43a3-a7da-4aa8f105aa22 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Calling method '.version_select at 0x7faaae991280>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:46.770625 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-3f709812-6efb-43a3-a7da-4aa8f105aa22 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] HTTP exception thrown: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3f709812-6efb-43a3-a7da-4aa8f105aa22 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/os-volumes/089eb7cb-9f04-4b06-b0a0-b67ec61fa266 HTTP/1.1 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:46.773587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '089eb7cb-9f04-4b06-b0a0-b67ec61fa266'} Aug 17 20:02:46.774848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. (HTTP 404) (Request-ID: req-b2db3013-a230-4d1e-a150-f8909f894b6a) Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.775644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:02:46.777047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:02:46.778161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. Aug 17 20:02:46.779232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:46.786162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3f709812-6efb-43a3-a7da-4aa8f105aa22 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 404 to user: Volume 089eb7cb-9f04-4b06-b0a0-b67ec61fa266 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:46.787715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3f709812-6efb-43a3-a7da-4aa8f105aa22 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/089eb7cb-9f04-4b06-b0a0-b67ec61fa266" status: 404 len: 109 microversion: 2.1 time: 0.316515 Aug 17 20:02:46.788977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:02:46 2022] DELETE /compute/v2.1/os-volumes/089eb7cb-9f04-4b06-b0a0-b67ec61fa266 => generated 109 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:02:46.799021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d8c5c63e-ebcf-4bcb-8353-18ead528ecb1 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Calling method '.version_select at 0x7faaae9e6b80>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:47.062387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-d8c5c63e-ebcf-4bcb-8353-18ead528ecb1 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] HTTP exception thrown: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d8c5c63e-ebcf-4bcb-8353-18ead528ecb1 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Request method failure captured: Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/os-volumes/f67423e2-6011-43b0-a8a3-9a113c012e0b HTTP/1.1 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UlkJyY_MlmYSQLHeLWvMnWrxLuD3eg-sHDh4qGE4-RRi_-3EsRPXOF_vMtp1mUatubBrNlGNy828OLenOSYp96HLZcv9eA5xdAAjBpHgb_-kkO3gVDwbta4tDgE1zOxyeAh6mGG562SdqgSBWw5VBTWeXSyFoSbjp0-8Zb4z4yqkhU Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:47.064839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c02701e05249459322208ed51226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c02701e05249459322208ed51226f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c02701e05249459322208ed51226f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: c0c02701e05249459322208ed51226f4 Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1331325286 Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 115ba18c2f034f9ea698e5a426846175 Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1331325286-project Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'f67423e2-6011-43b0-a8a3-9a113c012e0b'} Aug 17 20:02:47.066391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. (HTTP 404) (Request-ID: req-ccf07b53-f39f-44ed-8fd2-6136420f1b1d) Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:47.067223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:02:47.068357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:02:47.069432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d8c5c63e-ebcf-4bcb-8353-18ead528ecb1 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] Returning 404 to user: Volume f67423e2-6011-43b0-a8a3-9a113c012e0b could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d8c5c63e-ebcf-4bcb-8353-18ead528ecb1 tempest-VolumesNegativeTest-1331325286 tempest-VolumesNegativeTest-1331325286-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f67423e2-6011-43b0-a8a3-9a113c012e0b" status: 404 len: 109 microversion: 2.1 time: 0.271930 Aug 17 20:02:47.070580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:46 2022] GET /compute/v2.1/os-volumes/f67423e2-6011-43b0-a8a3-9a113c012e0b => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:02:47.215809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-afd7b133-229b-4e61-9695-5ce2acfb30f4 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.688736 Aug 17 20:02:47.227034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 1/9] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 17 20:02:43 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3702 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 20:02:47.233177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91255d20-3f65-4534-92a6-6cd3053e4b89 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaaeab6940>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:47.344490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91255d20-3f65-4534-92a6-6cd3053e4b89 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 200 len: 352 microversion: 2.1 time: 0.117767 Aug 17 20:02:47.345066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:47 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:02:48.371496 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9643d2f2-2bbc-4680-9b42-ed5e5d202f8a tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaaea09160>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:48.496315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9643d2f2-2bbc-4680-9b42-ed5e5d202f8a tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 200 len: 352 microversion: 2.1 time: 0.136754 Aug 17 20:02:48.497438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 2/11] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:48 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:02:49.512907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-eb39154a-5932-41c8-a4bb-3602ef24a20b tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaae991670>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:49.630928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-eb39154a-5932-41c8-a4bb-3602ef24a20b tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 200 len: 353 microversion: 2.1 time: 0.122606 Aug 17 20:02:49.640571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 10/12] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:49 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:02:49.660620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d35452d-fb32-498e-9799-ab5e396b7cec tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaaea09820>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:49.795276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d35452d-fb32-498e-9799-ab5e396b7cec tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 200 len: 353 microversion: 2.1 time: 0.155123 Aug 17 20:02:49.796912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 3/13] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:49 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:02:49.822083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-46b8f83d-7029-4baa-911e-972419dea578 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaae9915e0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:49.984366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-46b8f83d-7029-4baa-911e-972419dea578 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 202 len: 0 microversion: 2.1 time: 0.173355 Aug 17 20:02:49.988890 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 11/14] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:02:49 2022] DELETE /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:02:49.994291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c5e28c2c-494b-4440-b4a8-824018db8c07 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaaea09ee0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:50.144691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c5e28c2c-494b-4440-b4a8-824018db8c07 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 200 len: 352 microversion: 2.1 time: 0.154658 Aug 17 20:02:50.145431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 4/15] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:49 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:02:51.162180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a1881bc0-a285-4f77-8ba9-dd8653e94c51 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Calling method '.version_select at 0x7faaae991ee0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:02:51.252785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-a1881bc0-a285-4f77-8ba9-dd8653e94c51 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] HTTP exception thrown: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a1881bc0-a285-4f77-8ba9-dd8653e94c51 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Request method failure captured: Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 HTTP/1.1 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UljdB-LiUxkO9-NKlI444zv7ztXc32lalMj5JNZoTQR7jATPaLqtQ41eTOiDnA69nftAcJUjFSB1N0wpq_TmzFo1qVcME2f5IrEQEIPzdn6sRCNg3HEkmPQWjCobL0RMMG_n4jh5yWENAzebFqDWN0zkNpHShK9SteKE1qYY1axTjU Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 83184ecf125d4a99894aad39a9046b12 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesGetTestJSON-2036149097 Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:02:51.260197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83184ecf125d4a99894aad39a9046b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83184ecf125d4a99894aad39a9046b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83184ecf125d4a99894aad39a9046b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83184ecf125d4a99894aad39a9046b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesGetTestJSON-2036149097 Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 83184ecf125d4a99894aad39a9046b12 Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesGetTestJSON-2036149097 Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesGetTestJSON-2036149097-project Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 20968c5893fe42e79547c978d6873845 Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesGetTestJSON-2036149097-project Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1cf8fe9e-9fac-4cc4-8250-da994cbe59c0'} Aug 17 20:02:51.261339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. (HTTP 404) (Request-ID: req-f0e288aa-1036-463c-a8e2-dd5c536384a6) Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:51.262009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:02:51.262868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:02:51.263781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. Aug 17 20:02:51.264622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:02:51.267287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a1881bc0-a285-4f77-8ba9-dd8653e94c51 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] Returning 404 to user: Volume 1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:02:51.269236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a1881bc0-a285-4f77-8ba9-dd8653e94c51 tempest-VolumesGetTestJSON-2036149097 tempest-VolumesGetTestJSON-2036149097-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0" status: 404 len: 109 microversion: 2.1 time: 0.114061 Aug 17 20:02:51.271623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 12/16] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:02:51 2022] GET /compute/v2.1/os-volumes/1cf8fe9e-9fac-4cc4-8250-da994cbe59c0 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:02:52.764877 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b146b4d-b749-4b35-94b2-5cd6a80dc9f6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: .version_select at 0x7faaaea09d30>, body: {"keypair": {"name": "tempest-keypair-1058514039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUmNjhm4Ck2vrg/m53xnvaQiEg7eTSaT7sOw/c9uNxYzqSSU6kIBOGTWw6zc7y4ISqOFymkVvW7MiYNnWi7GcJUMSJq0J7a3J1CX5wImBEV8IZ+BKWGnAxAcQIMV03ukA=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:52.950048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-8b146b4d-b749-4b35-94b2-5cd6a80dc9f6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:02:52.974140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-8b146b4d-b749-4b35-94b2-5cd6a80dc9f6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:02:53.156282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b146b4d-b749-4b35-94b2-5cd6a80dc9f6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.863964 Aug 17 20:02:53.167481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 5/17] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:02:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:02:58.750781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1243425130", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75cad640-8a23-42bc-b03e-d2829e6ee836"}], "security_groups": [{"name": "tempest-securitygroup--1108250030"}], "key_name": "tempest-keypair-1058514039", "user_data": "}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:02:59.130032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] validate_networks() for [('75cad640-8a23-42bc-b03e-d2829e6ee836', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:01.022239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:01.022844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:01.023256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:01.023716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:01.024299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:01.082858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:01.083778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:01.084473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:01.085723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:01.087060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:01.089353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:01.170013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:01.181740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1711228460", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "networks": [{"uuid": "9105742e-03cc-4772-ab27-72d96b0effa0"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:01.194494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:01.230400 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:01.240478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:01.361757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] validate_networks() for [('9105742e-03cc-4772-ab27-72d96b0effa0', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:01.438675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-35d82d3b-fe40-4d3a-a123-8b3276c4f20e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.693129 Aug 17 20:03:01.445194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 13/18] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:02:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:03:01.451596 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-727cf75f-5c20-4830-a4d6-afae2c5fbf3c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:01.452334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-727cf75f-5c20-4830-a4d6-afae2c5fbf3c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:02.076462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-727cf75f-5c20-4830-a4d6-afae2c5fbf3c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:02.128488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-727cf75f-5c20-4830-a4d6-afae2c5fbf3c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1242 microversion: 2.1 time: 0.676388 Aug 17 20:03:02.129160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:01 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1242 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:02.661732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1421657005", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:02.857971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] validate_networks() for [('a9847bb8-3ad8-4f38-9815-0c15a509d918', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:03.026404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:03.705905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:03.706570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:03.707186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:03.707739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:03.708423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:03.734507 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:03.734995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:03.735427 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:03.736604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:03.737226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:03.737856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:03.802899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Getting quotas for project 5433b5d7443545249b9329f1ce9e3e02. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:03.809214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Getting quotas for user b095ab3c72b14c67adf61ab4189e4892 and project 5433b5d7443545249b9329f1ce9e3e02. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:03.844666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:03.847448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:03.957011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:03.957607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:03.958586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:03.959097 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:03.959612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:03.973668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:03.977489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a27c613f-1c54-4300-a1b1-4dafaf1ffe4d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.062397 Aug 17 20:03:03.985033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 6/20] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:03:03.985613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:03.986066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:03.986898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:03.998514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:04.002399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:04.054117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:04.072614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for user a5aece8a7f2342cfabd9a3f8707a4470 and project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:04.108704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:04.115730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:04.300684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-63ca080f-af7e-4eb6-b57a-4d5729ea5110 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.149656 Aug 17 20:03:04.303064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 15/21] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:03:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:03:04.330899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:04.331526 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:04.377893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:04.378060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:04.385411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:04.390219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:04.391893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:04.394038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:04.804974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53319d00-2ed8-4b71-9a21-56829df3c92d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: .version_select at 0x7faaae0ca430>, body: {"keypair": {"name": "tempest-keypair-913208509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs9jz1uAB6elmV3MARpAAFKUXqwd2i7Lu+xiNVvgRpeu6s80otVHIhBh+XkQK4TvVGH0z4a4/9YhnFthvlfZCQ+Z/1OnnzbebI/XpRS17mIM5aPEhtf9SjVzUem3g3GJQ=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:04.832920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-53319d00-2ed8-4b71-9a21-56829df3c92d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for project da5173bee1cf4ec09240370892c5b9e3. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:04.838109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-53319d00-2ed8-4b71-9a21-56829df3c92d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for user 3a40f55377b64f6f93784eefaf28152e and project da5173bee1cf4ec09240370892c5b9e3. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:04.872987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-53319d00-2ed8-4b71-9a21-56829df3c92d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.893131 Aug 17 20:03:04.874363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 7/22] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:03:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:04.884231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3aa844a-a0e5-465c-a489-29ae5d3a3712 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:04.885164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3aa844a-a0e5-465c-a489-29ae5d3a3712 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:04.909649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:04.930366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-08def210-6870-48ee-9b22-423e799f3c95 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1246 microversion: 2.1 time: 0.616565 Aug 17 20:03:04.931306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 16/23] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:04 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1246 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:04.936624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4c9379d7-d438-43c7-9770-2e0e16b7e055 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:04.942399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4c9379d7-d438-43c7-9770-2e0e16b7e055 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:05.043268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3aa844a-a0e5-465c-a489-29ae5d3a3712 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:05.109766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3aa844a-a0e5-465c-a489-29ae5d3a3712 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1215 microversion: 2.1 time: 0.229209 Aug 17 20:03:05.112296 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 8/24] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:04 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:05.146032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4c9379d7-d438-43c7-9770-2e0e16b7e055 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:05.174879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4c9379d7-d438-43c7-9770-2e0e16b7e055 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1222 microversion: 2.1 time: 0.236688 Aug 17 20:03:05.175587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 17/25] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:04 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:05.416651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772398442", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:05.586567 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] validate_networks() for [('a9847bb8-3ad8-4f38-9815-0c15a509d918', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:05.952360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:05.954327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:05.984059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:05.987655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:05.990301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:05.995630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:05.998597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:06.001878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:06.318726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:06.333139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e4418f64-2ab4-47cf-ad4d-ae6d4860c23a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1246 microversion: 2.1 time: 0.384712 Aug 17 20:03:06.337239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 18/26] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:05 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1246 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:06.343687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:06.345072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:06.351682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:06.352263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:06.353462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:06.354403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:06.355217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:06.355841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:06.690566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:06.720439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9a089b7c-b256-43ca-b733-69ddbfef112f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1219 microversion: 2.1 time: 0.378139 Aug 17 20:03:06.736029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 19/27] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:06 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1219 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:07.089362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:07.090908 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:07.092068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:07.093434 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:07.094105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:07.110360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.112184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.122254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.123470 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.124156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.124733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.156288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:07.167030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for user a5aece8a7f2342cfabd9a3f8707a4470 and project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:07.192277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:07.198263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:07.332862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-08fba0c2-edb9-42a0-8fb2-55bac24718b3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.921127 Aug 17 20:03:07.334476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 9/28] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:03:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:03:07.345774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f4a10ff0-0110-4483-8e7a-5612a7a0c2c2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:07.346710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f4a10ff0-0110-4483-8e7a-5612a7a0c2c2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:07.397398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:07.398412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:07.423724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.427259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.429760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.437001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.437643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.440308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.538735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f4a10ff0-0110-4483-8e7a-5612a7a0c2c2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:07.553461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f4a10ff0-0110-4483-8e7a-5612a7a0c2c2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1222 microversion: 2.1 time: 0.212189 Aug 17 20:03:07.558043 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 20/29] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:07 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:07.745093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:07.746109 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:07.763026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.770401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.771413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.775300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:07.776147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:07.777554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:07.866669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:07.911602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f8c5e501-ba99-4858-915c-8d344f9b9ad0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1302 microversion: 2.1 time: 0.552247 Aug 17 20:03:07.926294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 10/30] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:07 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1302 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:08.327519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:08.349130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-57278096-16bf-4dc5-b6d8-2c22d7a06220 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1267 microversion: 2.1 time: 0.596399 Aug 17 20:03:08.373617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 21/31] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:07 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1267 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:08.579495 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:08.581178 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:08.598028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:08.601330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:08.602043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:08.603164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:08.605934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:08.606561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:08.847882 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:08.860432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3f02697-a9eb-4cde-a57d-5a16240a70cb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1226 microversion: 2.1 time: 0.286378 Aug 17 20:03:08.864729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 11/32] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:08 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1226 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:08.937799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:08.938482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:08.952074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:08.952821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:08.954355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:08.955757 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:08.956379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:08.957878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:09.213213 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:09.238964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0dc30716-f42b-488b-a82d-bbdcae8e5b13 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1300 microversion: 2.1 time: 0.303184 Aug 17 20:03:09.240537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 22/33] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:08 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1300 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:09.380064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:09.380954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:09.392835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:09.393880 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:09.394520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:09.395393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:09.396193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:09.396792 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:09.805008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:09.808045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa213b39-eeb3-41fb-8a1d-4cde4ed1ee06 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1273 microversion: 2.1 time: 0.432506 Aug 17 20:03:09.814354 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 12/34] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:09 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:09.895276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:09.896668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:09.921292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:09.922912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:09.925800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:09.926786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:09.928052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:09.931594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:10.263878 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:10.265817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:10.276645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:10.277484 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:10.278170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:10.279584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:10.283884 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:10.284572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:11.146792 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:11.156182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6bca6406-01e4-4758-ade8-23599b3b95be tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1292 microversion: 2.1 time: 1.265505 Aug 17 20:03:11.156497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:11.162921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 23/35] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:09 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1292 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:11.173301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cde19ee5-8b08-469b-b86e-7694820a8d7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1300 microversion: 2.1 time: 0.915416 Aug 17 20:03:11.183256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:11.188134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 13/36] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:10 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1300 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:11.201255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:11.232149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:11.236120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:11.236828 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:11.238552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:11.247101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:11.247727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:11.414692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1052645001", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a2a392e-41f1-44dd-86d2-0bb085abeaad"}], "security_groups": [{"name": "tempest-securitygroup--1005244441"}], "key_name": "tempest-keypair-913208509", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:11.931037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:11.945784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6136ba5a-82c6-4e87-8db7-0f7fc720aa65 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1273 microversion: 2.1 time: 0.780832 Aug 17 20:03:11.947979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 24/37] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:11 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1273 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:11.973969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] validate_networks() for [('1a2a392e-41f1-44dd-86d2-0bb085abeaad', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:12.185086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:12.186618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:12.206668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.207257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.207708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:12.215047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.218096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.220265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:12.598654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:12.608069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ff6e0ae5-e55d-4064-a253-e0d2a2249b83 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1280 microversion: 2.1 time: 0.427684 Aug 17 20:03:12.610234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 25/38] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:12 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1280 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:12.634525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:12.637150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:12.653164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.657646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.658304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:12.662979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.663701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.664272 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:12.828105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:12.847749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-439c7d01-7dbf-4939-89b9-bcf38fba6af7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1300 microversion: 2.1 time: 0.218925 Aug 17 20:03:12.850188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 26/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:12 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:12.972164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:12.973512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:12.984130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.985521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.986287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:12.988603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:12.989380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:12.990233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.020996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=4 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:14.314809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:14.315338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:14.315686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:14.316093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:14.317098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:14.321857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:14.336033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.336520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.337502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.345949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.346550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.347503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.352200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:14.362548 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c2277db2-39ed-40d2-8aca-0ef20df56daf tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 1.396168 Aug 17 20:03:14.384370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 27/40] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:12 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:14.392815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for project da5173bee1cf4ec09240370892c5b9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:14.393411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:14.396061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:14.402535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for user 3a40f55377b64f6f93784eefaf28152e and project da5173bee1cf4ec09240370892c5b9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:14.412800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.413292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.413751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.414475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.414917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.415328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.444442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:14.447077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:14.560818 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2e3310b-5bea-4eae-a94b-eaf5779fccb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.150863 Aug 17 20:03:14.562499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 14/41] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:03:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:03:14.589079 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:14.590320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:14.599360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.600385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.601298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.602797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:14.603763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:14.606108 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:14.958927 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:14.979588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3822ffef-c321-4050-bac5-d1081053f0bf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1280 microversion: 2.1 time: 0.590630 Aug 17 20:03:14.983259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 28/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:14 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:15.015793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0d310ac6-f93c-45fa-9f63-a045212a6ef1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:15.017284 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0d310ac6-f93c-45fa-9f63-a045212a6ef1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:15.267200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0d310ac6-f93c-45fa-9f63-a045212a6ef1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:15.288758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0d310ac6-f93c-45fa-9f63-a045212a6ef1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1237 microversion: 2.1 time: 0.301977 Aug 17 20:03:15.292997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 29/43] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:14 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1237 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:15.384697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:15.385396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:15.395418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:15.397108 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:15.399318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:15.402962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:15.406525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:15.407401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:16.169799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:16.180969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ba89bff-cd77-4e54-aa7f-bf23f6fb5281 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 1.617100 Aug 17 20:03:16.184961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 15/44] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:14 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:16.200761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:16.201390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:16.243482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:16.243987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:16.244439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:16.245223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:16.261854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:16.262545 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:16.627260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:16.636623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d89ca59e-fb74-466b-b727-55576321fe52 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1280 microversion: 2.1 time: 0.450325 Aug 17 20:03:16.642428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 16/45] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:16 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:16.657076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:16.658110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:16.684544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:16.687616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:16.688782 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:16.693103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:16.693890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:16.694477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:17.001582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:17.019573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4bad0c14-f02b-4c3c-9cab-3543d4d21a26 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1289 microversion: 2.1 time: 0.369712 Aug 17 20:03:17.020493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 17/46] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:16 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1289 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:17.092519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:17.119990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f9819df4-bee3-49d7-9921-ed04a0493c43 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 1.739273 Aug 17 20:03:17.120603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 30/47] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:15 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:17.205696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:17.206286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:17.220750 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:17.227101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:17.227577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:17.241025 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:17.241865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:17.244466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:17.667401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:17.668196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:17.706109 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:17.711616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:17.712390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:17.717299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:17.721747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:17.724704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:18.398277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:18.408120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9753e919-5599-4889-ac68-7c690638031f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 1.207612 Aug 17 20:03:18.411249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 18/48] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:17 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:18.419022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:18.425271 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:18.434652 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:18.437886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:18.439936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:18.440977 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:18.442344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:18.445790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:18.463884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:18.477820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7f7b1a32-94d5-4332-8407-56d2ffdb237d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.815179 Aug 17 20:03:18.479039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 31/49] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:17 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:18.483975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:18.492771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:18.513752 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:18.514389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:18.516276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:18.518809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:18.525158 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:18.525961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:18.661265 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:18.672526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e8fc5c18-752e-4f77-bce2-a1775cf13064 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1295 microversion: 2.1 time: 0.259898 Aug 17 20:03:18.677334 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 19/50] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:18 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1295 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:18.940879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:18.950933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c1d0f0e2-1d3b-4008-8b0a-d122dfeda7c8 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.470516 Aug 17 20:03:18.954555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 32/51] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:18 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:19.440361 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:19.442543 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:19.461762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:19.463574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:19.465411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:19.468243 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:19.470687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:19.473279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:19.501939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:19.502410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:19.511777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:19.512278 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:19.512747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:19.522437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:19.522978 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:19.523423 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:20.479822 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:20.489405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-235b6fb8-fb1a-48dc-90c8-6c9b2b705ee9 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.991638 Aug 17 20:03:20.494125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 33/52] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:19 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:20.508560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:20.510116 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:20.523850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:20.532078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:20.532820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:20.533880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:20.534607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:20.535232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:20.585618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:20.595186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bd363b21-c2e1-43ae-8370-f9ef06439357 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 1.164925 Aug 17 20:03:20.614253 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 20/53] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:19 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:20.626638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:20.631342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:20.655229 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:20.656070 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:20.656720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:20.657740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:20.658632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:20.662839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:20.913446 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:20.920592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:20.962125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dd704be6-3f8c-42b5-af28-61eba0b5de4f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1295 microversion: 2.1 time: 0.461985 Aug 17 20:03:20.964247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 34/54] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:20 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1295 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:21.361018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:21.369381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9c3be2f7-7cef-4930-a2a3-52c0c0f75050 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.746674 Aug 17 20:03:21.387181 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 21/55] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:20 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:21.460152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0cf12b-6cf9-4949-aca9-f97c710bdc8e", "tag": "ad2b2082-63bd-4a99-bd2c-a95724875ff2"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:21.523664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.525630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.532042 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.656090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d340e8f6-36d5-46e1-ac27-57e642dc2204", "tag": "0443d835-baf6-4a9e-9a6b-41d106c3e3af"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:21.673789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Creating event network-changed:ad2b2082-63bd-4a99-bd2c-a95724875ff2 for instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e on hv-cinder-82002 Aug 17 20:03:21.675629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 20:03:21.676769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-60a1721e-b965-4a7e-85fa-69e23cec8027 req-6dc7fe4c-0788-4c79-a5f6-d6bc676961b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 20:03:21.689275 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.690728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.691312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.692231 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.692893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.693623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.719111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.724962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.733839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.744816 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.compute.rpcapi [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 20:03:21.752565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] Releasing lock "compute-rpcapi-router" {{(pid=120819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 20:03:21.787544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Creating event network-changed:0443d835-baf6-4a9e-9a6b-41d106c3e3af for instance d340e8f6-36d5-46e1-ac27-57e642dc2204 on hv-cinder-82002 Aug 17 20:03:21.788619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 20:03:21.789144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-316ad623-4ba7-4a64-8779-1639040da19d req-e3ad6891-4567-4d42-a27d-1cec75a76f70 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 20:03:21.791195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.791861 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.792730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.793678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.794261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.794933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.806544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-376d76d5-f785-4c21-9348-4104a95c0a14 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.840660 Aug 17 20:03:21.808070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 35/56] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:21.815039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:21.820639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:21.838268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.compute.rpcapi [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 20:03:21.845129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] Releasing lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 20:03:21.851497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.857888 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.859553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.862347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.862992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.864366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.898716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-615025e8-bfbd-4f47-9046-6c96ab35f56b None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496178 Aug 17 20:03:21.899979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 22/57] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:21.909988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:21.913438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:21.938458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.947409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.951546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:21.957767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:21.958441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:21.960350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:22.584881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:22.601194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e33a16cb-5eea-4f01-9152-f5dd1ba97ef7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.788480 Aug 17 20:03:22.602101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 36/58] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:21 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:22.641948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:22.642583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:22.655330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:22.659947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:22.660430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:22.662867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1cdde140-d2b1-4c3c-90dc-6034743be9b5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.761427 Aug 17 20:03:22.668187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 23/59] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:21 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:22.670584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:22.674004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:22.676118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:22.676479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:22.676961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:22.686498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:22.702704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:22.709779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:22.709779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:22.709779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:22.709779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:22.710261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:22.959374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:22.972332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bae17e75-b406-4a25-8137-be5b96b9e844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.300560 Aug 17 20:03:22.973384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 24/60] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:22 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:22.991189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:22.999723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5316736c-43d4-4b34-9413-17abb97ab111 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.396693 Aug 17 20:03:23.017325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 37/61] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:22 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:23.625180 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:23.626407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:23.636793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.637576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.638014 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.638933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.639437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.639807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.684257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:23.684848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:23.692502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.694940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.695371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.696577 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.697117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.697644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.877736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:23.887710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e6fbfd8e-a767-48d8-b23f-2f199d810f6d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.267428 Aug 17 20:03:23.888831 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 25/62] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:23 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:23.895412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91c0da64-b54d-4cd3-b37b-2319dca6a6df", "tag": "5e3dff07-c5c3-43f1-8b07-d7ba61d48163"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:23.907761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.908966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.909902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.924861 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] Creating event network-changed:5e3dff07-c5c3-43f1-8b07-d7ba61d48163 for instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df on hv-cinder-82002 Aug 17 20:03:23.931985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-48b86b4a-d3c2-4fa2-a0e3-978142e24b37 req-daa9f943-0448-4339-ab76-6aa3391002c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041206 Aug 17 20:03:23.934043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 26/63] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:03:23.950110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce34927-ae61-472f-b875-805b71bd8c12", "tag": "bb10f8d3-1fb6-4d69-a12a-50b827572b4b"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:23.963515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:23.964064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:23.965018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:23.968159 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:23.976132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-99019635-ac0f-4788-8fb5-289bcb1ef667 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.295866 Aug 17 20:03:23.976717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 38/64] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:23 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:23.989034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] Creating event network-changed:bb10f8d3-1fb6-4d69-a12a-50b827572b4b for instance 2ce34927-ae61-472f-b875-805b71bd8c12 on hv-cinder-82002 Aug 17 20:03:23.989034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-eabc8f0f-ccfd-460d-a968-4697d4489345 req-4388463f-5ab8-4485-ae33-79dedaccd95b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042375 Aug 17 20:03:23.989034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 27/65] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:03:23.994660 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:23.995821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:24.002440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.003202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.003495 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.004262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.004840 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.005460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.010094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:24.020896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:24.027330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:24.039579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.042039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.044430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.045189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.045891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.046346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.261683 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:24.279099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:24.290372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1d027704-dc4c-401e-a37d-04864a0e8ee8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.273204 Aug 17 20:03:24.291142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 39/66] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:24 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:24.300032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-777ca236-aabb-4017-b94d-70b3e41cff7c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.309327 Aug 17 20:03:24.300635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 28/67] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:23 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:24.908212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:24.909069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:24.915705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.916376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.917268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.918089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:24.918753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:24.919251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:24.997566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:24.998776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:25.001315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=24 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:25.010003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.010543 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.010977 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.011685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.012136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.012582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.106017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:25.114582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-22fac289-9130-4421-850e-00e9fc36296d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.210070 Aug 17 20:03:25.115168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 40/68] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:24 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:25.166124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:25.174221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-58c1029a-8fc6-4d57-ba43-ebfb7a6eb217 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.181643 Aug 17 20:03:25.174799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 29/69] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:24 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:25.311433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:25.312053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:25.314169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=20 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:25.319729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.320502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.321350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.322500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.323086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.323635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.323750 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:25.324298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:25.331113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.331792 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.332245 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.333062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:25.333481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:25.334066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:25.529831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:25.533807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:25.541317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b0230afd-18e5-4960-9c63-727a4e81612f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.233710 Aug 17 20:03:25.542026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 41/70] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:25 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:25.546395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c32ed6a7-4a2a-4aee-9484-28030ca040c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.227592 Aug 17 20:03:25.547756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 30/71] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:25 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:26.135074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:26.135682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:26.141984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.142544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.143037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.143786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.144306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.144783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.194394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:26.195212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:26.201999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.202626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.203074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.203774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.204218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.204627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.323383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:26.331251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2d1fa323-601e-40c4-bb4e-b2fbbc6603c8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.200005 Aug 17 20:03:26.332000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 42/72] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:26 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:26.371619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:26.381044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6a30ffb5-895f-4b1e-ba1e-780f66b4bdbe tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.190902 Aug 17 20:03:26.382958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 31/73] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:26 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:26.564404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:26.565359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:26.568337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:26.571999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.572726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.573197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.574026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.574381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.574853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.575256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:26.576007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:26.582016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.582478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.582899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.583578 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:26.584016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:26.584420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:26.941479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:26.944175 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:26.949994 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4b7b4aae-a006-4194-83fb-a963a220d9e1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.390891 Aug 17 20:03:26.952685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c8d8d2d8-2f69-4eba-840e-5bc037c1211e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.381213 Aug 17 20:03:26.953463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 32/74] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:26 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:26.956875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 43/75] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:26 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:27.351583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:27.352262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:27.365986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.365986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.365986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.365986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.366499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.366499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.403560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:27.404838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:27.414121 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.415210 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.416155 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.417587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.423619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.424490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.609597 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:27.618685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d92adfba-f3bb-4df7-9202-bf8da2758819 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.270856 Aug 17 20:03:27.625221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 33/76] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:27 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:27.642808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:27.650984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3a5bea82-7c77-4c24-9260-4f6674ac9a38 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.252819 Aug 17 20:03:27.653203 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 44/77] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:27 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:27.975347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:27.979847 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:27.980681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:27.981357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:27.992033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.994036 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.994504 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.995328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.995672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.996110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.996522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.997185 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.997711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:27.998682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:27.999134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:27.999794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.318096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:28.329896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d6221ae-34d7-4473-a81a-3157b13df6a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.361238 Aug 17 20:03:28.330902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 34/78] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:27 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:28.331947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:28.342574 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-34176170-bd0b-47bd-a324-5c0ab8024844 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.371479 Aug 17 20:03:28.343598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 45/79] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:27 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:28.595355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fcce73-27be-4ef7-a694-4e85c4d9ca67", "tag": "3258afea-705c-4b3a-9b43-978ed770565c"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:28.605087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:28.605583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:28.606018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.616993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] Creating event network-changed:3258afea-705c-4b3a-9b43-978ed770565c for instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 on hv-cinder-82002 Aug 17 20:03:28.622110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c7fdf94d-1791-4491-9888-0bf4bdaeaf64 req-2ee7bd16-2a33-464f-a83d-11249f775922 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Aug 17 20:03:28.622709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 35/80] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:28.639033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:28.639645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:28.645911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:28.646391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:28.646812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.647491 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:28.647936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:28.648350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.672963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:28.673670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:28.679982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:28.680500 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:28.681050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.681832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:28.682313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:28.682730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:28.832175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:28.840110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d988142e-dddd-4eb2-9b9d-12cd621025ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.205020 Aug 17 20:03:28.840651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 46/81] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:28 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:28.858215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:28.866059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-66e767fd-9882-452f-a89c-0d099f06183e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.197633 Aug 17 20:03:28.866635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 36/82] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:28 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:29.354889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:29.355640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:29.363463 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.364059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.364593 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.365200 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:29.365419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.365978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:29.366149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.366552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.373722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.374312 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.374965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.375811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.376363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.376876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.570815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:29.582252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-111b92d1-9e1a-4b5e-bb4c-2f7d2090736c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.233910 Aug 17 20:03:29.585909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 47/83] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:29 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:29.595667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:29.605329 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-be342224-c96a-4ea8-b85d-e8009663ee72 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.244831 Aug 17 20:03:29.606036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 37/84] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:29 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:29.860798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:29.861318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:29.867314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.867797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.868226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.868948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.869383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.869868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.887005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:29.887629 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:29.893809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.894276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.894697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:29.895365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:29.895799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:29.896203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:30.069655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:30.074653 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:30.078949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-71536d88-92ab-4b65-b20b-6b1135735508 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.222162 Aug 17 20:03:30.079535 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 48/85] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:29 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:30.082520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-42e4c4cc-bda0-4cd3-b885-2cd022cadacf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.199635 Aug 17 20:03:30.083076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 38/86] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:29 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:30.606647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:30.607256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:30.613460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:30.614018 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:30.614444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:30.615133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:30.615575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:30.615989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:30.628426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:30.629048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:30.635736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:30.636222 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:30.636648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:30.637393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:30.637874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:30.638316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:30.812206 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:30.820165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6e2c8993-0440-42d1-941a-adb94cffd3b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.217328 Aug 17 20:03:30.820837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 49/87] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:30 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:30.826709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:30.834378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f7fa75e8-d519-4fa2-ab9b-52b7f5a9705e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.209947 Aug 17 20:03:30.835391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 39/88] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:30 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:31.104194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:31.105034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:31.106116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:31.106756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:31.111519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.111997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.112434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.112827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.113110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.113281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.113564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.113703 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.113998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.114412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.114854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.115267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.319876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:31.328199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:31.328638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-babdc23e-bf26-4fe7-8543-6967a7a0199f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.231380 Aug 17 20:03:31.329481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 50/89] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:31 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:31.335475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-61580365-8dab-41b5-acf9-a1993b60e646 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.234859 Aug 17 20:03:31.336065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 40/90] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:31 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:31.842412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:31.843215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:31.845168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:31.850363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.851122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.851547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.852215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.852659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.853097 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.856225 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:31.856838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:31.858845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:31.864333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.864883 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.865391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:31.866150 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:31.866665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:31.867141 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:32.115540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:32.119911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:32.126462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-241751c7-a9a4-41e4-9b28-cf448c321a0c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.288135 Aug 17 20:03:32.137571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 51/91] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:31 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:32.242788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:32.250903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4d92394d-28c3-4d5f-9e4e-c16c7612800b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.398978 Aug 17 20:03:32.251470 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 41/92] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:31 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:32.351984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:32.352957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:32.357057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:32.358403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:32.360930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:32.362232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:32.362916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:32.363996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:32.364735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:32.365373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:32.365658 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:32.366203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:32.366833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:32.367771 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:32.368815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:32.369324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:32.832937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:32.846319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:32.859687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a2512fd9-1420-447e-80a9-6f72ae268e9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.505873 Aug 17 20:03:32.874449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 42/93] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:32 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:32.874532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-31e6c0e1-1163-484b-9576-c6c32f3139ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.520310 Aug 17 20:03:32.874532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 52/94] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:32 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:33.148966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:33.149857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:33.158086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.158576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.159005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.160186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.160646 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.161433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.273058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:33.273822 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:33.280777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.281674 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.282153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.283002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.283622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.284038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.300401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:33.307909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e4338d74-51ce-4bb5-a92c-05819b1f7605 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.163132 Aug 17 20:03:33.309157 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 43/95] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:33 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:33.419952 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:33.429444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4b16c576-b9ed-45b8-bb33-f86faa12957a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.161006 Aug 17 20:03:33.430059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 53/96] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:33 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:33.883859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:33.885129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:33.888295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:33.888900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:33.894978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.895931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.896722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.897473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.897702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.897990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.898119 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.898672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.898910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:33.900331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:33.900960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:33.901818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:34.123005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:34.128015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:34.131016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0cbfed47-83f1-466c-acce-92981c627199 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.246938 Aug 17 20:03:34.131926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 54/97] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:33 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:34.138016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b9ced89-ef9f-417c-93d5-36b983700126 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.258255 Aug 17 20:03:34.139249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 44/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:33 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:34.328371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:34.329196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:34.335175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:34.335656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:34.336092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:34.336772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:34.337221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:34.337681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:34.450240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:34.450843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:34.456902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:34.457300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:34.457761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:34.458441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:34.458876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:34.459281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:34.477221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:34.480783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:34.494730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fbd64484-3720-4f42-9f90-c1f3ad1dab9e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.170124 Aug 17 20:03:34.495321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 55/99] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:34 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:34.601103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:34.608675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ae07909c-fc40-4d4f-af02-2f4b261be6fd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.163370 Aug 17 20:03:34.609228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 45/100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:34 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:35.155585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:35.156396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:35.159429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:35.160015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:35.164606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.165086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.165749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.166424 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.166898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.167308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.173451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.173982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.174429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.175162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.175589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.176009 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.425762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:35.435975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bef41956-27ef-4d50-a617-44262f610276 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.286891 Aug 17 20:03:35.441997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 56/101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:35 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:35.444800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:35.453829 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-12a241b4-0d04-4308-b5df-e88fda51f784 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.298481 Aug 17 20:03:35.454532 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 46/102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:35 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:35.515748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:35.516346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:35.532512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.533419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.534228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.535124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.535957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.536687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.629858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:35.630744 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:35.640570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.641381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.642502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.643718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:35.644564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:35.645198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:35.849901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:35.859722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-04ab367a-2f04-4c00-8cef-290db498d2a9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.347927 Aug 17 20:03:35.860373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 57/103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:35 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:35.892841 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:35.900135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e643c5a0-3944-4c34-859f-6b9c55da9a1a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.275453 Aug 17 20:03:35.900682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 47/104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:35 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:36.463203 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:36.463965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:36.471086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.471683 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.472444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.473959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.474450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.474835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:36.475306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.475449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:36.483647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.484407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.485098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.486052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.486716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.487353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.733453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:36.740538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:36.742484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9d9d5576-d5f6-43fb-9b23-02bb9f099a5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.282331 Aug 17 20:03:36.743412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 58/105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:36 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:36.748667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8da7d273-1c49-4dc4-9a00-a076aeb43012 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.278030 Aug 17 20:03:36.749263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 48/106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:36 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:36.881188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:36.881804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:36.888219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.888691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.889299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.890110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.891393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.892250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.928719 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:36.929412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:36.946343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.946824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.947648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:36.948552 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:36.948961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:36.949525 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:37.179494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:37.188665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ea8ae04b-e4cf-49e4-a927-376f9384f294 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.311737 Aug 17 20:03:37.190057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 59/107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:36 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:37.195028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:37.203875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7ab76ee6-5d09-4a6c-a2d1-871468ef553c tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.279302 Aug 17 20:03:37.204587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 49/108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:36 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:37.765281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:37.765879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:37.771760 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:37.772243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:37.772464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:37.772941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:37.773099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:37.773523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:37.773917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:37.774538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:37.780473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:37.781227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:37.781842 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:37.782618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:37.783133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:37.783664 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:37.986922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:37.996369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4051c1ec-26ae-4c13-a0c3-d204d4d65df4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.235975 Aug 17 20:03:38.003328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 60/109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:37 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:38.016471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:38.024622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2995c5a3-65e5-47eb-ab9a-d40fcd7c0f6c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.256299 Aug 17 20:03:38.025210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 50/110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:37 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:38.211241 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:38.211849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:38.220437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:38.220437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:38.220437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:38.225318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:38.225993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:38.229461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:38.231982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:38.232960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:38.238862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:38.239478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:38.239763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:38.240459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:38.240897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:38.241309 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:38.472887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:38.480668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-20b8d79e-49b2-46a4-a314-63fc95fdd155 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.273291 Aug 17 20:03:38.494619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:38.494619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4c81435e-3edf-4a19-83d2-5d6d838f8ac5 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.270829 Aug 17 20:03:38.495446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 51/112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:38 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:38.495705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 61/112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:38 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:39.017928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:39.018539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:39.024850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.025320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.025868 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.026658 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.027172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.027631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.044460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:39.045060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:39.052448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.053037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.053755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.054646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.055291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.055895 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.226278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:39.241941 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9edfd2f9-c555-45f5-a3f9-9d83a5171a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.227715 Aug 17 20:03:39.242543 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 52/113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:39 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:39.271604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:39.280315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-92a241c1-38a9-44a8-b8b9-97cf24d02ef9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.239281 Aug 17 20:03:39.294216 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 62/114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:39 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:39.501153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:39.501786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:39.507779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.508251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.508671 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.509352 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.509816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.510224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.517727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:39.518345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:39.525167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.525782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.526289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.527230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:39.527794 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:39.528242 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:39.730873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:39.738747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b3157b5f-6165-4386-abc1-5c40fb253929 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.241546 Aug 17 20:03:39.739520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 53/115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:39 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:39.742608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:39.751255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-debf8fd1-da70-46dd-904a-1a6b46568d5d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.237634 Aug 17 20:03:39.752061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 63/116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:39 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:40.264561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:40.265094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:40.273789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.274271 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.276089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.276845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.277674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.278080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.304961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:40.305475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:40.313098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.313843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.314449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.315359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.315808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.316281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.488462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:40.503332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8faa0b5-7319-4189-93c8-23aaafd04733 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.243941 Aug 17 20:03:40.504285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 54/117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:40 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:40.558778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:40.576427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d0e957d9-a8d1-4f58-bbcc-26b4ca94ca46 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.275399 Aug 17 20:03:40.577315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 64/118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:40 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:40.760413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:40.761220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:40.770714 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.771381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.772137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.773007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.773623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.774186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.784347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:40.784956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:40.791861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.792381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.793212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:40.793848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:40.794276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:40.794686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.146005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:41.161961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:41.166124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-18354f83-547a-43a9-a653-0d8443fbb3a7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.409378 Aug 17 20:03:41.167481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 55/119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:40 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:41.171090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5c92b38d-2501-46a5-8cde-63f9e945b091 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.394742 Aug 17 20:03:41.172285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 65/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:40 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:41.177085 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1868618258", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:41.230556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] validate_networks() for None {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:03:41.236706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d340e8f6-36d5-46e1-ac27-57e642dc2204", "name": "network-vif-plugged", "status": "completed", "tag": "0443d835-baf6-4a9e-9a6b-41d106c3e3af"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:41.246730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.247220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.247737 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.259355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] Creating event network-vif-plugged:0443d835-baf6-4a9e-9a6b-41d106c3e3af for instance d340e8f6-36d5-46e1-ac27-57e642dc2204 on hv-cinder-82002 Aug 17 20:03:41.264371 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-0d25c6d0-f350-4137-aa2e-4bb2fd16837e req-933df0c3-6ccb-4ffb-996c-a5ba34e40bbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095139 Aug 17 20:03:41.264965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 56/121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:41.502480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:03:41.502959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:03:41.503344 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:03:41.503742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:03:41.504149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:03:41.513477 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.513988 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.514415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.515124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.515571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.515983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.525776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:41.526596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:41.533093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.533574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.533844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Getting quotas for project 997dd7a0c62947e09c6cab0cddcc75d5. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:03:41.534062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.534734 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.535182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.535593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.538071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Getting quotas for user 7389adc9e92743ab921b375a2cbe117e and project 997dd7a0c62947e09c6cab0cddcc75d5. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:03:41.557603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:03:41.559903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:03:41.649473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-793be5a2-e47b-4651-9219-e765ddaa89fe tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474110 Aug 17 20:03:41.650653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 66/122] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:03:41.674472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:41.675072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:41.693106 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.693804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.694520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.696688 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:41.697338 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:41.698077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:41.706537 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:41.716182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-931dffeb-de71-407b-bf0e-8e3ce3dd1c40 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.194786 Aug 17 20:03:41.717928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 57/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:41 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:41.723568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-803687ab-bec3-472a-98f5-6c1419d3d92d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:41.724333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-803687ab-bec3-472a-98f5-6c1419d3d92d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:41.727521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:41.811942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-803687ab-bec3-472a-98f5-6c1419d3d92d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:41.818487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-803687ab-bec3-472a-98f5-6c1419d3d92d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1215 microversion: 2.1 time: 0.098939 Aug 17 20:03:41.819235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 58/124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:41 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:41.878749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:41.886882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-526c2b98-0ce3-4b10-b493-ae2a1033f912 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.230679 Aug 17 20:03:41.887789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 67/125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:41 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:42.187979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:42.188569 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:42.195138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:42.195296 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.195763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:42.195894 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.196212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.196903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.197361 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.197952 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.202172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.202794 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.203186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.203923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.204388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.204790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.399647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:42.404415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:42.407719 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-db23a419-90a2-43d7-98ac-12e683df5b67 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.223610 Aug 17 20:03:42.408282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 59/126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:42 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:42.412052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-07a480dd-4599-4c90-b9ce-835db0bdf1dd tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.220779 Aug 17 20:03:42.412603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 68/127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:42 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:42.738105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:42.738696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:42.746124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.746711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.747194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.747993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.748346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.748967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.841394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:42.842050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:42.848567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.849040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.849462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.850178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.850584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.851190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.855169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:42.884699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:42.892635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c9195a97-62c0-40c7-a18e-d5666f5988ad tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.158439 Aug 17 20:03:42.893207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 60/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:42 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:42.907697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:42.908395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:42.914785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.915002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.915280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:42.915412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.916095 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:42.916536 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:42.916945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:42.923262 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b31fc60e-804c-43da-af65-d1d63870b474 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.085696 Aug 17 20:03:42.923838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 69/129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:42 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:43.051928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:43.059479 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7fd17b1b-9917-44c3-a062-47859da028f2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.155564 Aug 17 20:03:43.060048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 61/130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:42 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:43.434876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:43.435120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:43.435551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:43.435688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:43.441769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.441931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.442246 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.442391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.442645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.442840 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.443338 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.443537 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.443794 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.443937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.444210 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.444344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.631767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:43.634963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:43.639544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-87323d87-6c45-40fe-877e-c2e3d61c9daa tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.210060 Aug 17 20:03:43.640214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 62/131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:43 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:43.642785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-db88ef25-5fb5-4eb7-88d8-6feeea2f44b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.216692 Aug 17 20:03:43.643309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 70/132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:43 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:43.913446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:43.914138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:43.920659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.921004 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.921430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.922477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.922912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.923320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.943595 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:43.944179 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:43.950542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.951012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.951455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:43.952373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:43.952809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:43.953219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.033971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:44.041655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c882f764-d7d1-4725-aed4-fbfb134ace83 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.102036 Aug 17 20:03:44.042266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 71/133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:43 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:44.075467 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:44.079962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:44.085977 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-231846af-8839-42cd-8b02-d053d32c2dee tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.175952 Aug 17 20:03:44.086789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 63/134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:43 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:44.088553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:44.089473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:44.096515 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.097282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.099853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.100686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.101139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.101577 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.236020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:44.248524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-522af10c-f3dd-44d5-8a08-a758c9e7536b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.165668 Aug 17 20:03:44.249390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 72/135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:44 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:44.663224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:44.663848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:44.664341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:44.664970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:44.672678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.673368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.673740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.673895 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.674326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.674565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.674972 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.675108 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.675442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.675672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:44.676133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:44.676549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:44.871860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:44.876158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:44.880069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1b22b97e-6348-48d9-b979-d5fd8ac39c70 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.220757 Aug 17 20:03:44.884345 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bd47a162-ad34-4b20-a894-0b1c006e4fae tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.227424 Aug 17 20:03:44.889592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 64/136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:44 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:44.894399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 73/137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:44 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:45.066930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:45.067921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:45.077056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.077493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.077964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.078665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.079102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.079510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.108377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:45.108936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:45.115293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.115776 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.116207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.116894 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.117342 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.117796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.141258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:45.148815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-db36e266-3c8f-403d-b7fa-7d33532ddac1 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.088487 Aug 17 20:03:45.149399 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 65/138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:45 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:45.253030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:45.260853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d7133e1e-8d50-4177-bf01-f1c3a114a2e8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.156391 Aug 17 20:03:45.261404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 74/139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:45 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:45.274549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:45.275352 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:45.284711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.285386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.286037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.287008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.287633 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.288185 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.418320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:45.428226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8124c35d-c1df-400f-88b1-9bcccecd1a9d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.157863 Aug 17 20:03:45.428817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 66/140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:45 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:45.900652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:45.901261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:45.907621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.908021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:45.908492 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.908605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.908700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:45.909243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.909714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.910281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.914936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.915425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.915846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:45.916533 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:45.917011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:45.917426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.104970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:46.108226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:46.112655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-08162f1a-9b32-4f7c-aa6d-dd0bfb17997f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.215860 Aug 17 20:03:46.113360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 75/141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:45 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:46.116182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a84187c3-63a7-4583-b0d0-71f87aae41d1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.211968 Aug 17 20:03:46.116730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 67/142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:45 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:46.171619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:46.172581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:46.179199 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.179666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.180085 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.180754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.181189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.181630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.244173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:46.254136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-04ba8183-8fc0-427f-82cd-33e5f2a2099b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.086304 Aug 17 20:03:46.254714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 76/143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:46 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:46.280890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:46.281558 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:46.288060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.288532 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.288967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.289677 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.290127 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.290535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.424225 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:46.432160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-722f2b1b-a888-4eec-bd2f-aac705d0a735 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.155130 Aug 17 20:03:46.432729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 68/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:46 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:46.448251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:46.448854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:46.455406 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.455881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.456305 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.456986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:46.457427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:46.457880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:46.597574 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:46.605231 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-02f3910d-e527-41ea-88e9-8d592381886a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.160803 Aug 17 20:03:46.605799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:46 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:47.133087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:47.133896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:47.136973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:47.137576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:47.140121 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.140598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.141019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.141827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.142272 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.142682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.143949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.144413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.144829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.145500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.145961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.146353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.334257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:47.338037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:47.343600 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ee84ecf8-6017-4bbb-aed1-572b6aefb07b tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.210395 Aug 17 20:03:47.344219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 78/146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:47 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:47.345585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-140123c3-4fa5-4d6a-94ff-99a11fdbf6a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.216409 Aug 17 20:03:47.346303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 69/147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:47 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:47.348917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:47.349410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:47.355413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.356037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.356477 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.357162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.357659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.358105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.419310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:47.427649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-52be46da-5b66-4d92-8248-7bbb189a8112 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.082400 Aug 17 20:03:47.428252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 79/148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:47 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:47.452758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:47.453367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:47.461937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.462415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.462954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.463597 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.464037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.464453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.604135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:47.612178 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-deeed9b3-5d16-45f9-9d77-79d27a83a65a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.163507 Aug 17 20:03:47.612741 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 70/149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:47 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:47.626082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:47.626692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:47.633014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.633496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.633958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.634640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:47.635088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:47.635506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:47.772212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:47.779669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91c864c4-2c8d-45b4-a2a7-b80411b36104 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.157708 Aug 17 20:03:47.780234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 80/150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:47 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:48.368428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:48.369402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:48.370271 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:48.371374 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:48.379688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.380028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.380151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.380503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.380616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.380976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.381303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.381685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.381815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.382105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.383779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.383869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.580114 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:48.586993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:48.595793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8ef27ff9-d788-4786-8d1a-76b8a38af88b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.231871 Aug 17 20:03:48.596511 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 81/151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:48 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:48.598893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ef5b485-092e-4b6a-ba1c-617a44d4f336 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.236852 Aug 17 20:03:48.602930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:48.604008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:48.610471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.611024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.611519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.612449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.612965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.613469 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.614704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 71/152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:48 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:48.635007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:48.635798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:48.646973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.647497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.647958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.648686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.649134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.649679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.680554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:48.687974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d3355c15-1c24-42e6-84ba-6abf4ac5fcd4 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.090268 Aug 17 20:03:48.688550 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 82/153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:48 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:48.801028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:48.801674 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:48.808088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.808576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.809009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.809749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:48.810194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:48.810604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:48.991950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:49.000662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1b0741dc-b1c4-4fed-9608-af9386a2a5a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.371777 Aug 17 20:03:49.001466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 72/154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:48 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:49.036302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:49.043952 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a5565bd2-03d1-49c2-ad21-ae0a64a53dc0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.247273 Aug 17 20:03:49.044493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 83/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:48 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:49.179739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0cf12b-6cf9-4949-aca9-f97c710bdc8e", "name": "network-vif-plugged", "status": "completed", "tag": "ad2b2082-63bd-4a99-bd2c-a95724875ff2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:49.191991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.193021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.193662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.206525 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] Creating event network-vif-plugged:ad2b2082-63bd-4a99-bd2c-a95724875ff2 for instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e on hv-cinder-82002 Aug 17 20:03:49.213057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c98a3cb7-a80e-45b0-9aa5-55ba7bc9e89d req-49b4420b-756c-4a6b-9d03-2ebb0f86d647 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039084 Aug 17 20:03:49.213930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 73/156] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:49.617455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:49.618244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:49.621459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:49.622160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:49.625107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.625598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.626027 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.626714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.627146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.627626 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.628252 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.628748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.629160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.629900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.630341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.630748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.852768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:49.852955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:49.861388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-75d611a4-2a51-4754-a518-ebac1f1ee82a tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.245616 Aug 17 20:03:49.865244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-12fee117-39b5-4fc7-ab34-328d75dae4bd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.251785 Aug 17 20:03:49.866134 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 84/157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:49 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:49.870849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:49.871519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:49.877821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.878529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.878944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.879785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:49.880234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:49.880460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 74/158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:49 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:49.880652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:49.993523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:49.998827 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:50.008152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2447e458-5786-4b9a-8bc8-e5fb3b506f0c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1219 microversion: 2.1 time: 0.140780 Aug 17 20:03:50.008753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 85/159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:49 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:50.024353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:50.025063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:50.033258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.034137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.034830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.036386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.038629 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.039312 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.066249 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:50.067243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:50.086525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:50.099140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.102821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.104223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.106953 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.107644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.109663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.633529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:50.641645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-592a92e2-0d5a-461a-8a9b-e9fe123f64c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.580652 Aug 17 20:03:50.642332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 86/160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:50 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:50.684039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:50.692130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8ffa8d52-f882-4a95-8f38-3b0cb461f290 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.672587 Aug 17 20:03:50.693078 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 75/161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:50 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:50.888997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:50.889923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:50.899398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.900718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:50.901585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:50.911061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.913961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.914603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.915594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.916026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.916487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.917227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:50.917719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.918357 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:50.920582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:50.921586 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.330847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:51.343013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:51.352358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-deb241fa-4a90-4181-99a2-90372f688008 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.468127 Aug 17 20:03:51.353729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d3f92d8a-6cb4-46e2-bb70-05d154398c8e tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.457218 Aug 17 20:03:51.354821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 76/162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:50 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:51.370803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 87/163] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:50 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:51.373474 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:51.374302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:51.381259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.382015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.382610 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.383458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.384041 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.384590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.484752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:51.496502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5c835076-339f-465e-bf2f-5a311ff3f1c9 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1273 microversion: 2.1 time: 0.126816 Aug 17 20:03:51.510852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 77/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:51 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:51.618370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c0da64-b54d-4cd3-b37b-2319dca6a6df", "name": "network-vif-plugged", "status": "completed", "tag": "5e3dff07-c5c3-43f1-8b07-d7ba61d48163"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:51.631797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:51.632906 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:51.635583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.638236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.639307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.662991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:51.663568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:51.676333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.677267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.677780 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.678413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.678866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.679257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.682099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] Creating event network-vif-plugged:5e3dff07-c5c3-43f1-8b07-d7ba61d48163 for instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df on hv-cinder-82002 Aug 17 20:03:51.714188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-e9cfcb4e-9ea1-42e1-a9a4-62fe42e6548e req-3e184f52-5c39-4e76-8662-c1fb16cb3ede service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080087 Aug 17 20:03:51.715290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 88/165] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:51.732005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:51.733430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:51.746186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.746660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.747303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.749340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:51.750020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:51.750639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:51.816473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:52.001983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:52.014342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e5b57933-5258-4bcd-9657-491d86f76874 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.355620 Aug 17 20:03:52.015187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 78/166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:51 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:52.038598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:52.046205 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5d0e7b04-2e7f-42e1-bc09-f53dc29b1cf6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.328901 Aug 17 20:03:52.056672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 89/167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:51 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:52.375514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:52.376126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:52.379567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:52.380642 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:52.383653 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.384341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.384918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.385794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.386388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.386951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.389387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.389938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.390544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.392326 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.392793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.393664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.638887 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:52.644743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:52.649867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-53d6bf87-57b1-4e35-8d11-5455471dc004 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.278332 Aug 17 20:03:52.651869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 79/168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:52 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:52.655334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-393050f0-a120-4c33-b29c-f3b8a00be7a7 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.280272 Aug 17 20:03:52.657005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 90/169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:52 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:52.675217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:52.675966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:52.693600 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.694107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.694535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.695366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:52.695841 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:52.697644 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:52.791895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:52.802620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7ce8369e-697b-48dc-af5c-d876d247e9bf tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1273 microversion: 2.1 time: 0.148867 Aug 17 20:03:52.803970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 80/170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:52 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:53.035293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:53.035898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:53.042211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.042707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.043126 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.043897 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.044516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.044955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.071172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:53.073220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:53.091101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.096418 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.097236 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.098341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.098813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.099377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.104016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:53.339330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:53.348160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9eee614a-1701-4181-963e-a9e77be493f7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.316647 Aug 17 20:03:53.349140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 91/171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:53 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:53.392539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:53.404035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-87557ba8-bae4-44d4-a028-de980229bf44 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.339105 Aug 17 20:03:53.418118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 81/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:53 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:53.672412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:53.673120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:53.679689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:53.680593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:53.700260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.700975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.701588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.703117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.703589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.705098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.705860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.706764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:53.708246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.709316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:53.710439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:53.714044 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.030654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:54.041319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-de5833fa-a67a-41f4-bd65-c0695f8391c0 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.365868 Aug 17 20:03:54.055273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 82/173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:53 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:54.055273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce34927-ae61-472f-b875-805b71bd8c12", "name": "network-vif-plugged", "status": "completed", "tag": "bb10f8d3-1fb6-4d69-a12a-50b827572b4b"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:54.055442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:54.057873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d160990b-1cc3-48b4-bf9d-f1850ab4b934 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.389373 Aug 17 20:03:54.058951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 92/174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:53 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:54.059813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.060406 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.060895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.072974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] Creating event network-vif-plugged:bb10f8d3-1fb6-4d69-a12a-50b827572b4b for instance 2ce34927-ae61-472f-b875-805b71bd8c12 on hv-cinder-82002 Aug 17 20:03:54.079576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c086b046-b09f-4fe2-a806-a35ab7493a1b req-b34fae77-8595-4d84-9bc6-dfd26e1dd96c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Aug 17 20:03:54.080394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 83/175] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:54.080988 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:54.081887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:54.089936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.090456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.091280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.091980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.092426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.093001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.163971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:54.180673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4ea2e94e-393f-4360-ba4c-6ecc35d9b6ad tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1273 microversion: 2.1 time: 0.119879 Aug 17 20:03:54.181710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 93/176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:54 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:54.374638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:54.375709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:54.384680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.385820 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.387126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.387126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.387741 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.388404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.430592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:54.431982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:54.446589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.448727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.449265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.454318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:54.454881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:54.467016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:54.872017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:54.886967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82a327c9-4e42-4329-b9c0-9763b26881a7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.517600 Aug 17 20:03:54.888492 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 84/177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:54 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:54.903228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:54.914442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9de38cdc-c5e6-46d8-a6bd-cc362189fc69 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.489055 Aug 17 20:03:54.915023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 94/178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:54 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:55.062584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:55.063414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:55.069757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.070451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.070878 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.071730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.072313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.072875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.079713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:55.080303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:55.088707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.089844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.090445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.091139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.091850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.092579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.292336 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:55.301043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8516eb07-d9f9-449c-a138-43e72c710167 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.242479 Aug 17 20:03:55.302312 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 85/179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:55 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:55.307134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:55.307863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:55.314652 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.315464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.315984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.316772 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.317422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.317954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.345399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:55.357501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6559b7da-3a1d-49dc-963f-bb027c74e756 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.280442 Aug 17 20:03:55.359533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 95/180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:55 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:55.473033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:55.480718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-528180ac-1a24-4d4e-ba0a-dc2271708180 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.177132 Aug 17 20:03:55.494467 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 86/181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:55 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:55.915481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:55.916133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:55.922433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.922915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.923341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.924048 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.924497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.924915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.936823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:55.937684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:55.944084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.944775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.945343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:55.946213 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:55.946803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:55.947362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.180124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:56.188851 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-18e88b7d-e28b-45a1-b25b-72552ca66f16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.277418 Aug 17 20:03:56.189629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 96/182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:55 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:56.210453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:56.222250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2d02c221-7537-44b1-8e4d-8d253dd6eaaa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.289773 Aug 17 20:03:56.223207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:55 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:56.324883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:56.326516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:56.336482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.337184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.337741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.338656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.339253 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.339991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.378701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:56.379640 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:56.394295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.396420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.397452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.398641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.401196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.402162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.542892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:56.557441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-745100b4-2774-4336-b9a5-3a966bb9c155 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.238324 Aug 17 20:03:56.558704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 97/184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:56 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:56.566191 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:56.566860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:56.581289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.584380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.584921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.585809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:56.586474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:56.587498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:56.621311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:56.630126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ff8c3e4c-3db7-468c-bd12-cc6cd65cb013 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.255501 Aug 17 20:03:56.631995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 88/185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:56 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:56.756231 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:56.770111 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a218dabe-2796-4976-aba9-77e2e26aff01 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.207583 Aug 17 20:03:56.770698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 98/186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:56 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:57.209473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:57.210350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:57.219802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.220642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.221136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.221919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.222504 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.223090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.246845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:57.248416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:57.257454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.262687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.263308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.264301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.264901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.265688 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.462216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:57.469985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-914bc55b-2a36-4d57-90f5-4e10d897d76f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1368 microversion: 2.1 time: 0.264476 Aug 17 20:03:57.470574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 89/187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:57 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:57.499685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:57.508935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-11614ed7-3fed-42a7-8209-23586c94febd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1322 microversion: 2.1 time: 0.268423 Aug 17 20:03:57.510090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 99/188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:57 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:03:57.580924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:57.582316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:57.594688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.595385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.595991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.596925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.597556 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.600251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.653365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:57.655382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:57.663031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.663839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.664482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.665381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.666154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.666787 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.854359 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:57.867433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-da0db809-e5c6-471b-96b8-307c03012f19 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.290097 Aug 17 20:03:57.870174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 90/189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:57 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:57.875051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:57.875656 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:57.878938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:57.882003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.883353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.884011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.884924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:57.886128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:57.886697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:57.888621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-159e4b09-be1c-4a20-a5fa-b43553e14125 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.239974 Aug 17 20:03:57.889774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 100/190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:57 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:58.046227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:58.058528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d78ff50c-d690-4b53-97cb-44d818631f05 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.186850 Aug 17 20:03:58.059204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 91/191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:57 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:58.497747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:58.499259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:58.512710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.513376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.514146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.515126 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.516054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.516674 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.531722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:58.532443 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:58.555189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.558663 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.559222 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.560228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.561528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.565049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.821141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:58.823402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:58.835557 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9bd77949-297d-4296-b9c3-cb358471ecf0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1517 microversion: 2.1 time: 0.309082 Aug 17 20:03:58.836149 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 92/192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:58 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:58.841024 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1212b43b-5902-46cb-87df-c15099957d7c", "tag": "62b2d8b4-ea93-4f83-951c-9d705e7c7059"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:58.844373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-90721e35-80f8-46b0-9cd4-1f91f3328aba tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1558 microversion: 2.1 time: 0.358366 Aug 17 20:03:58.844997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 101/193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:58 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1558 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:58.854260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.854729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.855151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.863189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:03:58.865879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:58.873375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.873890 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.874615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.878520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.879209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.879848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.886951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] Creating event network-changed:62b2d8b4-ea93-4f83-951c-9d705e7c7059 for instance 1212b43b-5902-46cb-87df-c15099957d7c on hv-cinder-82002 Aug 17 20:03:58.892362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-fa5357d2-8243-4984-ab3e-6f32cbbee086 req-7959d8a4-cd8a-4c6d-8466-9915b517d666 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054971 Aug 17 20:03:58.893085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 93/194] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:58.899328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:58.900137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:58.907476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.907957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.908406 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.909124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:58.909668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:58.910415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:58.995515 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lazy-loading 'flavor' on Instance uuid d340e8f6-36d5-46e1-ac27-57e642dc2204 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:03:59.109611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:59.125110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ae66b3cb-c2c5-43f6-a6f4-48e02bc25880 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229525 Aug 17 20:03:59.126093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:03:58 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:03:59.132862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:59.134053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:59.140929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.141645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.146137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.146924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.147519 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.148058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.204263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1779fc67-2823-48e2-bea4-1ed705d68ac5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204/action" status: 200 len: 32 microversion: 2.1 time: 0.344779 Aug 17 20:03:59.205527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 102/196] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:03:58 2022] POST /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 20:03:59.212283 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:59.213567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:59.222052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.223122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.223700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.224570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.225165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.225605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.359015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:59.371350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d4cdea99-82df-4b03-b171-650461c102ca tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.240969 Aug 17 20:03:59.372282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 95/197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:59 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:59.382870 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:59.383728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:59.397368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.399863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.400430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.401355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.402846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.403698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.459615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:59.468487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-46e0ce16-b671-461d-a284-4017e16635e8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.261693 Aug 17 20:03:59.469973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 103/198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:59 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:59.492813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:03:59.496680 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:03:59.507272 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.508490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.508997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.509800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:03:59.510475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:03:59.511499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:03:59.714643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:59.727871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-505847a3-7f60-43f8-8db7-40b58703548f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.353017 Aug 17 20:03:59.732481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 96/199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:59 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:03:59.801954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:03:59.813023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-869f4f6a-a68c-4435-88e3-01e88d84ebbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.326370 Aug 17 20:03:59.815525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:03:59 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:00.393441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:00.394570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:00.407009 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.409353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.411000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.412451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.415805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.416526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.497521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:00.504700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:00.514243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.514852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.527222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.528446 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.530608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.531547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.920964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:00.926432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:00.934047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f8342bc6-6b45-42af-8e4c-3244d8749020 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1315 microversion: 2.1 time: 0.545250 Aug 17 20:04:00.934551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-52f5c1d5-c060-41d8-85af-d81df0762abe tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.445235 Aug 17 20:04:00.935849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 97/201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:00 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:00.941134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:00.941849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:00.942475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 105/202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:00 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:00.949494 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.950227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.950844 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.952075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.952719 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.953447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.957768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:00.958349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:00.976907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.977474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.977925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:00.978618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:00.979062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:00.979470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:01.362102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:01.374480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d491b2c7-a160-402d-9ae4-217bff214228 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.432453 Aug 17 20:04:01.375135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:00 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:01.380139 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0cf12b-6cf9-4949-aca9-f97c710bdc8e", "tag": "ad2b2082-63bd-4a99-bd2c-a95724875ff2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:01.405218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:01.416977 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:01.417982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:01.432913 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] Creating event network-changed:ad2b2082-63bd-4a99-bd2c-a95724875ff2 for instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e on hv-cinder-82002 Aug 17 20:04:01.438203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-9844d78e-c606-4c5c-8e1a-c74dff06600d req-b254b9d6-edea-4bc8-9eff-d5f8f999c21a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061691 Aug 17 20:04:01.439188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 99/204] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:01.476963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:01.486743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c82134b1-dc1d-4b69-a9d1-29d3619da661 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.541530 Aug 17 20:04:01.487334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 106/205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:00 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:01.962793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:01.964077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:01.966045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:01.967885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:01.979205 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:01.979864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:01.980361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:01.981599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:01.982403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:01.982964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:01.983451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:01.984418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:01.987790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:01.988694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:01.989049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:01.989469 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.020646 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:02.318260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:02.334858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8831ba1d-3813-4ab8-a668-d2d33900b81e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.376174 Aug 17 20:04:02.353281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:01 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:02.359781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fcce73-27be-4ef7-a694-4e85c4d9ca67", "name": "network-vif-plugged", "status": "completed", "tag": "3258afea-705c-4b3a-9b43-978ed770565c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:02.378284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:02.382447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:02.382993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:02.383629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.387858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e2ec9476-36e3-479d-aa96-fc4e8866b1b9 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1501 microversion: 2.1 time: 0.435225 Aug 17 20:04:02.388893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:01 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1501 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:02.400100 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:02.401027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:02.407590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:02.408199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:02.409907 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.410057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] Creating event network-vif-plugged:3258afea-705c-4b3a-9b43-978ed770565c for instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 on hv-cinder-82002 Aug 17 20:04:02.411315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:02.411988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:02.412602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.421311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-80ad6485-a534-4d03-a6fb-b38e7f81c6cb req-c1e62194-9650-4b00-9cbd-facea7e5e937 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065887 Aug 17 20:04:02.425296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 108/208] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:02.508320 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:02.510532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:02.522315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:02.522890 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:02.525230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.527476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:02.529455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:02.529981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:02.833679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:02.841619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1ecbeda8-c484-4bfa-9788-0d109da8ec04 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.450538 Aug 17 20:04:02.842272 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:02 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:02.883564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:02.894648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-669b8b13-ac66-40a0-8c45-935c41470bed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.390162 Aug 17 20:04:02.895725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 109/210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:02 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:03.361973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:03.363490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:03.369896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.370379 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.370822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:03.371503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.371930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.372355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:03.596690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:03.606570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-795a885a-5f5c-47f3-ba93-eca8a8e8f440 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.249272 Aug 17 20:04:03.610757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:03 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:03.865147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:03.866954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:03.874386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.874911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.875334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:03.876069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.876671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.877120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:03.917060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:03.917876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:03.927105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.928606 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.930122 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:03.938939 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:03.941594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:03.943848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:04.095998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:04.105428 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-17aee6b6-454b-441b-aa91-a90a3cfc724a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.245396 Aug 17 20:04:04.106666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:03 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:04.171415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:04.180118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-194c583a-7f39-4977-89ed-886d6bbb30e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.267433 Aug 17 20:04:04.180723 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:03 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:04.628973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:04.629630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:04.636104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:04.636581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:04.637014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:04.637733 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:04.638177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:04.638594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:04.773975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:04.781907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e1207ab2-92cf-4866-8e85-0a474a5df043 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.156845 Aug 17 20:04:04.782480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 111/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:04 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:05.126769 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:05.127448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:05.134118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.134585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.135003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.135678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.136123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.136533 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.202285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:05.202940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:05.211464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.212298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.212745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.213709 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.214437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.215003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.355694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:05.366287 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e6a28c10-670b-4b0b-94df-43a59138562f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.243512 Aug 17 20:04:05.367133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:05 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:05.397643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b64b69a-5265-47bf-9d73-08f028a708bf"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:05.402007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:05.411396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.411886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.412372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.413136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.413585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.414000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.451612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:05.468642 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b2d83b59-45a6-47ed-adb2-4df191f0151c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.270023 Aug 17 20:04:05.485466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:05 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:05.803825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:05.804527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:05.821386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.822497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.823149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:05.824337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:05.824997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:05.825930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:06.054196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:06.062452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-32f0d29b-fb07-459a-9da4-04c288fe653d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.263000 Aug 17 20:04:06.063015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 113/217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:05 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:06.391743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:06.392516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:06.398938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:06.399398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:06.399933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:06.400451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:06.400883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:06.401280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:06.534609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:06.542405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1b7cd356-6211-42ab-9648-84bc3a20ad0f tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.154597 Aug 17 20:04:06.542987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 114/218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:06 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:06.548068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:06.548660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:06.554510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:06.554976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:06.555589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:06.556268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:06.556711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:06.557123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:06.693119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:06.701078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b0895b94-29dd-42ff-aef1-1f566fd934ef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.156991 Aug 17 20:04:06.701669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 115/219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:06 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:07.083846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:07.084564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:07.091304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.092223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.092656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.093396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.094034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.094618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.236021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:07.245197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-636305b7-6e96-4ba4-8400-ac24eaa03a36 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1363 microversion: 2.1 time: 0.166132 Aug 17 20:04:07.245797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 116/220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:07 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:07.566022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:07.566650 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:07.573083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.573613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.574195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.575097 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.575667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.576230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.714659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:07.723949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-11024762-c66f-4eca-a1a5-3af23f1687d7 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.162710 Aug 17 20:04:07.724712 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 117/221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:07 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:07.733070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:07.735052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:07.745004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.745691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.746215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.746958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:07.747540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:07.748142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:07.770093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:08.131977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:08.151746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ea592950-ba1a-4df0-9d08-9643abc7d043 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.425051 Aug 17 20:04:08.154586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 118/222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:07 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:08.267980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:08.268712 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:08.276812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.277758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.278544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:08.279345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.279974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.280609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:08.415277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:08.423047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7a1959ab-a4d8-4a8c-a776-5be676bb9ce0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1550 microversion: 2.1 time: 0.159425 Aug 17 20:04:08.423600 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 119/223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:08 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:08.444678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:08.445156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:08.451461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.451954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.452372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:08.453037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.453749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.454162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:08.537243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-59316493-e6f0-4db8-b39f-7c5fc53355ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096020 Aug 17 20:04:08.538237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 120/224] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:04:08 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:08.747680 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:08.748371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:08.754863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.755380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.755781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:08.756533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:08.756986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:08.757626 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:09.070306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:09.085815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c2d047ba-d368-401c-91a4-eabb7fa47ffb tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.342101 Aug 17 20:04:09.086945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 121/225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:08 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:09.182290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:09.183200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:09.191926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:09.192889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:09.193574 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:09.194514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:09.195232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:09.196589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:09.218933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d165c3e2-a2be-4217-b2b7-2f77478b269f tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "POST /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.828674 Aug 17 20:04:09.220205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 105/226] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:04:05 2022] POST /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df/os-volume_attachments => generated 194 bytes in 3831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:09.536574 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:09.545422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b9f9aa78-979b-4880-84b6-1a9593da8c53 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.368190 Aug 17 20:04:09.548080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 122/227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:09 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:10.107879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:10.109237 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:10.119140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.119955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.120543 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.121452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.122289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.122799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.254027 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fcce73-27be-4ef7-a694-4e85c4d9ca67", "tag": "3258afea-705c-4b3a-9b43-978ed770565c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:10.271201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.271656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.272080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.295172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] Creating event network-changed:3258afea-705c-4b3a-9b43-978ed770565c for instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 on hv-cinder-82002 Aug 17 20:04:10.301247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-23ab477b-404e-4e7a-ae4f-966f9cca8183 req-10cfb993-9286-4126-86a6-9c789d594466 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052125 Aug 17 20:04:10.301999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 123/228] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:10.352418 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:10.374318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2775ba2f-f524-4b88-bbb5-ce61cbbb74e8 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.271186 Aug 17 20:04:10.376294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 106/229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:10 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:10.427908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1212b43b-5902-46cb-87df-c15099957d7c", "name": "network-vif-plugged", "status": "completed", "tag": "62b2d8b4-ea93-4f83-951c-9d705e7c7059"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:10.444450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.445201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.446113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.459269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] Creating event network-vif-plugged:62b2d8b4-ea93-4f83-951c-9d705e7c7059 for instance 1212b43b-5902-46cb-87df-c15099957d7c on hv-cinder-82002 Aug 17 20:04:10.465259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-d3930740-db03-4317-8637-875938745258 req-91956540-2ea6-4de2-be5a-8415b9713215 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042396 Aug 17 20:04:10.466404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 124/230] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:10.571923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:10.572770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:10.578628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:10.581594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.582278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.582872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.583763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:10.584358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:10.585053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:10.772872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:10.781286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bd5943df-ca8e-4fe5-bce4-fc953582b4e3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.213793 Aug 17 20:04:10.781910 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 107/231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:10 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:11.397195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:11.398580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:11.408907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:11.410298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:11.411005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:11.411861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:11.412453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:11.413000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:11.634604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:11.642905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-56f53250-835a-4807-9df8-7ac585930215 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.250017 Aug 17 20:04:11.643580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 125/232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:11 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:11.803279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:11.803972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:11.810687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:11.811466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:11.811965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:11.812756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:11.813306 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:11.813847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:11.959316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:11.967858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f1eeb83-87b3-4e7e-ac89-b8dcd7659f00 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.168567 Aug 17 20:04:11.968530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 108/233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:11 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:12.664533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:12.665238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:12.676101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:12.676953 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:12.678041 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:12.679304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:12.679796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:12.680358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:12.844882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:12.852782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d5d2da4c-52ab-49e9-a92b-4b8253502b5a tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1315 microversion: 2.1 time: 0.192317 Aug 17 20:04:12.853738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 126/234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:12 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:12.988364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:12.988972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:12.995559 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:12.996022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:12.996432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:12.997102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:12.997555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:12.997983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:13.160209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:13.167779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f8b31f68-6ae8-4fb2-bdea-dc9b34d039a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.183439 Aug 17 20:04:13.168346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 109/235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:12 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:13.874386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:13.874980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:13.886555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:13.887037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:13.887517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:13.888208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:13.888652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:13.889064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.027769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:14.035942 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1f21f26b-3372-4453-b218-d72267abab2b tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1465 microversion: 2.1 time: 0.165350 Aug 17 20:04:14.036522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 127/236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:13 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:14.084486 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:14.087274 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:14.093811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.094281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.094699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.095383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.095854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.096228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.124224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:04:14.190971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:14.191651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:14.198058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.198736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.199160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.199834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.200276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.200715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.233768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2f8c24ff-94bd-44c3-88eb-456bcf2b9808 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 204 len: 0 microversion: 2.1 time: 0.152635 Aug 17 20:04:14.238740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 110/237] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:04:14 2022] DELETE /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:04:14.244611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:14.245585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:14.253896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.254617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.255204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.256058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:14.256672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:14.257234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:14.409117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:14.418609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fa8a5920-25d7-4978-ab25-aa84e2980be0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.231764 Aug 17 20:04:14.420350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 128/238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:14 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:14.445423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:14.454562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-67128281-56f6-4f38-aaaf-c5850ef1e1fd tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1471 microversion: 2.1 time: 0.214206 Aug 17 20:04:14.455258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 111/239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:14 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:15.440282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:15.440905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:15.447475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:15.447955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:15.448370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:15.449061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:15.449507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:15.449954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:15.475645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:15.476280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:15.484032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:15.484531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:15.484966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:15.486005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:15.486230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:15.486700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:15.658357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:15.666276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-99e5bf36-bb3f-4e4f-822f-fe1790cd006d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.229864 Aug 17 20:04:15.666861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 129/240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:15 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:15.679985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:15.691205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c67a6ebc-ea25-46ab-aa2c-5321dd92c2a3 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1471 microversion: 2.1 time: 0.219267 Aug 17 20:04:15.691862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 112/241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:15 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:16.688071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:16.689200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:16.696781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:16.697475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:16.698494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:16.699364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:16.700028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:16.701099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:16.712079 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:16.712688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:16.723514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:16.725198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:16.725946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:16.727408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:16.728091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:16.729154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:16.941163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:16.945316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:16.948972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:16.951396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-85bbd0bd-2678-43d6-b0ba-aa13f2359936 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.267801 Aug 17 20:04:16.953326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-98d678a4-ac1b-4b34-b776-d137cd0543f0 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1471 microversion: 2.1 time: 0.244994 Aug 17 20:04:16.954123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 113/242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:16 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:16.959235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 130/243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:16 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:17.930605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1212b43b-5902-46cb-87df-c15099957d7c", "name": "network-vif-deleted", "tag": "62b2d8b4-ea93-4f83-951c-9d705e7c7059"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:17.949962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:17.950846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:17.951288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:17.965794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] Creating event network-vif-deleted:62b2d8b4-ea93-4f83-951c-9d705e7c7059 for instance 1212b43b-5902-46cb-87df-c15099957d7c on hv-cinder-82002 Aug 17 20:04:17.973450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-4da876f4-2b72-4a56-bb90-3291db045ea2 req-4ba73ed7-1670-417e-9942-7f3904078591 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046744 Aug 17 20:04:17.974537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:17.975237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:17.979228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 114/244] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:17.982507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:17.983264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:17.983865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:17.984749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:17.985197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:17.985649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:17.985773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:17.986356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:17.992972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:17.993836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:17.994271 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:17.995527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:17.996163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:17.996738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:18.163932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:18.172799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c4febe6e-1fa6-4677-9412-bc801c32ce71 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1429 microversion: 2.1 time: 0.191498 Aug 17 20:04:18.173428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 115/245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:17 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:18.337489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:18.343757 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7c9151e4-d742-4e6a-9566-5752bd208dbf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.374436 Aug 17 20:04:18.344578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 131/246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:17 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:19.194398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:19.194995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:19.202318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:19.202788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:19.203205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:19.203888 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:19.204665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:19.205049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:19.307373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:19.315740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d3f6e4a0-7776-4149-a81a-f05b4bd4340d tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1429 microversion: 2.1 time: 0.125228 Aug 17 20:04:19.317512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 116/247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:19 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:19.367215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:19.368439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:19.376967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:19.377453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:19.377913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:19.378646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:19.379094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:19.379568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:19.553440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:19.564255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-251ba2f4-8d66-40ae-b75b-84017945dcde tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.203675 Aug 17 20:04:19.577605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 132/248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:19 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:20.339430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:20.340035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:20.351260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:20.351753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:20.352181 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:20.352884 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:20.353338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:20.353787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:20.401752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:20.402232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:20.402735 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:20.403193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lazy-loading 'fault' on Instance uuid 1212b43b-5902-46cb-87df-c15099957d7c {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:04:20.458728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7389adc9e92743ab921b375a2cbe117e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997dd7a0c62947e09c6cab0cddcc75d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:20.466745 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-df915ddc-cb65-40c3-8c20-731f91bf2880 tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 200 len: 1305 microversion: 2.1 time: 0.131262 Aug 17 20:04:20.467504 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 117/249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:20 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:20.585144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:20.585782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:20.591725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=93 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:20.593334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:20.594108 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:20.594532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:20.596368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:20.597413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:20.597850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:20.766696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:20.776520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-579aa74f-d350-4511-becd-d53ce3f70aff tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.195529 Aug 17 20:04:20.778024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 133/250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:20 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:21.314838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:21.315432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:21.326308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.327438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.328480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.329189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.329810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.330374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.377238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:04:21.495469 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:21.496520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] [instance: 1212b43b-5902-46cb-87df-c15099957d7c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:21.502675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1c542c9b-b3ec-4be0-9354-adb5a2bd8b73 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 204 len: 0 microversion: 2.1 time: 0.190430 Aug 17 20:04:21.503815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 118/251] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:04:21 2022] DELETE /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:04:21.510546 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.511735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.512378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.513361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.513916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.514522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.517588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:21.518289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:21.528043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.528660 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.529325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.530119 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.530564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.531033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.532953 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] HTTP exception thrown: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Request method failure captured: Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c HTTP/1.1 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Umbj6N7Df_MoHl4Faw-MvtVs1XUdvMwEwcBCFPl_ATxDhCvLZemMrOtp4oBiKzDT68nskoTo6FPvU2ZI5DW-3Vas0P7wuuW8UDcPJy67277Kfumt3fCRmISSvAmjGKLoQpssZMQc1yb6L_hFWGIPYzCtdyBXJlNh-iylXyBUsGZpmM Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 997dd7a0c62947e09c6cab0cddcc75d5 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesNegativeTest-1255021306 Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:04:21.545030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/997dd7a0c62947e09c6cab0cddcc75d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_997dd7a0c62947e09c6cab0cddcc75d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/997dd7a0c62947e09c6cab0cddcc75d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/997dd7a0c62947e09c6cab0cddcc75d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesNegativeTest-1255021306 Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 997dd7a0c62947e09c6cab0cddcc75d5 Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesNegativeTest-1255021306 Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesNegativeTest-1255021306-project Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 7389adc9e92743ab921b375a2cbe117e Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesNegativeTest-1255021306-project Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. Aug 17 20:04:21.546562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1212b43b-5902-46cb-87df-c15099957d7c'} Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:21.547764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. Aug 17 20:04:21.549057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:21.550672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] Returning 404 to user: Instance 1212b43b-5902-46cb-87df-c15099957d7c could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:21.550672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6e646a9c-8a14-4c5f-8203-53e930f1b18c tempest-VolumesNegativeTest-1255021306 tempest-VolumesNegativeTest-1255021306-project] 10.222.0.18 "GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c" status: 404 len: 111 microversion: 2.1 time: 0.065631 Aug 17 20:04:21.554531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 134/252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:21 2022] GET /compute/v2.1/servers/1212b43b-5902-46cb-87df-c15099957d7c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:21.711695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:21.720359 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-55b84e8d-2727-4548-86a7-0d9b0ca7669d tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1553 microversion: 2.1 time: 0.211971 Aug 17 20:04:21.720936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 119/253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:21 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:21.799082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:21.799758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:21.806176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.806643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.807064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.807744 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:21.808180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:21.808697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:21.994552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:22.006411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7bafd382-0cc7-4dad-94ed-7b0311b6f954 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.212012 Aug 17 20:04:22.006998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 135/254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:21 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:22.742826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:22.743444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:22.751052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:22.751715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:22.752123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:22.752711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:22.753108 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:22.753771 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:22.900720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:22.908888 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f4187e1-b288-465c-87a0-29d54bf9e015 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1553 microversion: 2.1 time: 0.170004 Aug 17 20:04:22.909592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 120/255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:22 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:23.027648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:23.028250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:23.034654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.035127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.035615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:23.036295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.036741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.037154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:23.181096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:23.188909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-14c48a1c-4bb8-4e73-9ce3-4f65dbf066ed tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.165089 Aug 17 20:04:23.189470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 136/256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:23 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:23.255890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1885156236", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "networks": [{"uuid": "89d5a6c5-1fb3-4067-b5ce-52db0e0bfe2f"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:23.310887 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] validate_networks() for [('89d5a6c5-1fb3-4067-b5ce-52db0e0bfe2f', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:04:23.688460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:04:23.688881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:04:23.689356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:04:23.689837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:04:23.690248 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:04:23.700353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.701222 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.701793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:23.702587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.703110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.703595 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:23.720836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Getting quotas for project 04042df62e7941d7a6d9d1cf493d9602. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:04:23.725429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Getting quotas for user 1e6508646820461591015314de163c2f and project 04042df62e7941d7a6d9d1cf493d9602. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:04:23.742172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:04:23.744775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:04:23.798054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9e15a16c-2ce0-4394-9264-e44208d5a2e0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545852 Aug 17 20:04:23.798705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 121/257] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:04:23.811408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9c1c48d4-ff8b-4a61-bc39-73b2d3bc314d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:23.811863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9c1c48d4-ff8b-4a61-bc39-73b2d3bc314d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:23.873048 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9c1c48d4-ff8b-4a61-bc39-73b2d3bc314d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:23.880708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9c1c48d4-ff8b-4a61-bc39-73b2d3bc314d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1214 microversion: 2.1 time: 0.073851 Aug 17 20:04:23.882402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 137/258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:23 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:23.932101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:23.932925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:23.940894 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.941376 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.942162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:23.943211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:23.943950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:23.944510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:24.093113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:24.102695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1f3b2bde-7c7a-4e87-a36e-c04cb67d33b6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1553 microversion: 2.1 time: 0.174674 Aug 17 20:04:24.103517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 122/259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:23 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:24.209974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:24.211036 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:24.218864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:24.219613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:24.220371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:24.221312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:24.222141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:24.222762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:24.242604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.362899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:24.373136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2d82755f-00c4-402f-9436-8adde1d055d0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.165557 Aug 17 20:04:24.373136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 138/260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:24 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:24.903200 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:24.903767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:24.911398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:24.911868 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:24.912535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:24.913219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:24.913678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:24.914089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:24.984514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:24.994799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5e2ad12a-4427-461e-8b08-336c42ab8e2e tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1266 microversion: 2.1 time: 0.096517 Aug 17 20:04:24.995587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 123/261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:24 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:25.128547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:25.129233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:25.135524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:25.136006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:25.136433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:25.137127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:25.137613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:25.138022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:25.224458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c0da64-b54d-4cd3-b37b-2319dca6a6df", "name": "network-vif-deleted", "tag": "5e3dff07-c5c3-43f1-8b07-d7ba61d48163"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:25.227869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:25.237485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ba26af5f-5107-4ab8-9684-0ce8b8bd8ac6 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1511 microversion: 2.1 time: 0.112812 Aug 17 20:04:25.238743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 139/262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:25 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:25.239922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:25.240410 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:25.241503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:25.258367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] Creating event network-vif-deleted:5e3dff07-c5c3-43f1-8b07-d7ba61d48163 for instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df on hv-cinder-82002 Aug 17 20:04:25.263701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-e28de287-fb4f-4d74-9f39-e2bde73390f9 req-339fbc99-9f59-4fef-92d1-0adaece65789 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045483 Aug 17 20:04:25.264396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 124/263] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:25.391357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:25.391954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:25.398107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:25.398579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:25.398999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:25.399684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:25.400763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:25.401180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:25.559638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:25.575136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a58ac8d4-ea99-4708-89cb-ea69ff410a20 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.187564 Aug 17 20:04:25.577434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 140/264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:25 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:26.018031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:26.019553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:26.026780 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.027620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.028251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.029439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.030211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.030961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.112568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:26.122839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aaab2e65-9179-438b-9d2d-6e26b2f1f346 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1272 microversion: 2.1 time: 0.109931 Aug 17 20:04:26.124088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 125/265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:26 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:26.259173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:26.261072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:26.270769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.271681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.272319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.273273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.273954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.274594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.312910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.313407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.313856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.314376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lazy-loading 'fault' on Instance uuid 91c0da64-b54d-4cd3-b37b-2319dca6a6df {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:04:26.412868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095ab3c72b14c67adf61ab4189e4892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5433b5d7443545249b9329f1ce9e3e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:26.428750 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-51883962-69db-4abf-9d9c-4652ce815e38 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 200 len: 1351 microversion: 2.1 time: 0.171351 Aug 17 20:04:26.433954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 141/266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:26 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 1351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:26.599128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:26.600902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:26.614375 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.614858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.615286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.615980 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:26.616633 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:26.616834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:26.860053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:26.874475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-42b2aa8e-0dc4-47a0-9961-b7abfdbeabef tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.276134 Aug 17 20:04:26.875093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 126/267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:26 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:27.144318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:27.145928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:27.151341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.151825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.152247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.153275 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.153877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.154512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.280550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122a24d7-a76a-4bbf-b53d-3e2715fb8f2c", "tag": "2a37a6b3-740b-4999-95c8-73b6238dc581"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:27.291132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.299505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.300913 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.316159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] Creating event network-changed:2a37a6b3-740b-4999-95c8-73b6238dc581 for instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c on hv-cinder-82002 Aug 17 20:04:27.317665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:27.323599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-6a8c46a2-7079-4c3f-83d5-5ca70e7a8a1c req-4e945032-0a85-4209-9f28-72cb3a5197b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048115 Aug 17 20:04:27.324696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 127/268] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:27.327068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7c7d6426-f385-409b-b83b-a7c10c0c77cf tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.186522 Aug 17 20:04:27.327781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 142/269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:27 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:27.452702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:27.453816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:27.460710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.461572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.462298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.463453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.464206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.464968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.480306 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] HTTP exception thrown: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Request method failure captured: Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df HTTP/1.1 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul07V2FD0gRDTCouguxDKPHmx9yFuVbg27jrucrpEA0iKs46xCUdYltV1-eLitRRF1afJVHCUe491fVdHyAWOrztPilKyDEDbm5gy1i5J4R38C9bbcahin1M0FU_sl8tTD1VGJ-EDSShY1eiKRYVQYiPybPPoBe_dsGBDT_8UzYzYM Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:04:27.486466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: b095ab3c72b14c67adf61ab4189e4892 Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.487699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '91c0da64-b54d-4cd3-b37b-2319dca6a6df'} Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:27.488389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.489622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.492488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Returning 404 to user: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:27.493384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-772669ff-1ee0-427c-91f8-73efc785f848 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 404 len: 111 microversion: 2.1 time: 0.045490 Aug 17 20:04:27.494086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 128/270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:27 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:27.636023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:27.638505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:27.644919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.645397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.645853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.646543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.646986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.647399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.669788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] HTTP exception thrown: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Request method failure captured: Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df/os-volume_attachments HTTP/1.1 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul07V2FD0gRDTCouguxDKPHmx9yFuVbg27jrucrpEA0iKs46xCUdYltV1-eLitRRF1afJVHCUe491fVdHyAWOrztPilKyDEDbm5gy1i5J4R38C9bbcahin1M0FU_sl8tTD1VGJ-EDSShY1eiKRYVQYiPybPPoBe_dsGBDT_8UzYzYM Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:04:27.671603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: b095ab3c72b14c67adf61ab4189e4892 Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.673223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'server_id': '91c0da64-b54d-4cd3-b37b-2319dca6a6df'} Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:27.673900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:27.675819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:27.677390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Returning 404 to user: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:27.677390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ab9c16a3-aaa9-4878-a30d-d13aef9377d3 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041649 Aug 17 20:04:27.677390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 143/271] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:04:27 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:27.897893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:27.898590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:27.904844 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.905321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.905784 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:27.906475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:27.906923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:27.907343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.039747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:28.047732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7f6a44b8-214d-4b9a-85b9-b671f969be16 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.153530 Aug 17 20:04:28.048468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 129/272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:27 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:28.347341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:28.348175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:28.354521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.354990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.355432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.356110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.356555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.357141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.494391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:28.501954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-44d0f912-b3ca-48e7-973f-1b58b2fadc38 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.158640 Aug 17 20:04:28.502729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 144/273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:28 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:28.917923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:28.918415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:28.925611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.926098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.926619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.927313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.927765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.928185 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.941705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] HTTP exception thrown: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Request method failure captured: Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df HTTP/1.1 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul07V2FD0gRDTCouguxDKPHmx9yFuVbg27jrucrpEA0iKs46xCUdYltV1-eLitRRF1afJVHCUe491fVdHyAWOrztPilKyDEDbm5gy1i5J4R38C9bbcahin1M0FU_sl8tTD1VGJ-EDSShY1eiKRYVQYiPybPPoBe_dsGBDT_8UzYzYM Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:04:28.943391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: b095ab3c72b14c67adf61ab4189e4892 Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.944577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '91c0da64-b54d-4cd3-b37b-2319dca6a6df'} Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:28.945234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.946319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.947451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Returning 404 to user: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:28.947451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8dacb51f-33f3-43b6-ad35-f37183606400 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 404 len: 111 microversion: 2.1 time: 0.030886 Aug 17 20:04:28.947451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 130/274] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:04:28 2022] DELETE /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:28.953512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:28.954142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] [instance: 91c0da64-b54d-4cd3-b37b-2319dca6a6df] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:28.960238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.960715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.961147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.961858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:28.962306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:28.962754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:28.976131 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] HTTP exception thrown: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Request method failure captured: Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df HTTP/1.1 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul07V2FD0gRDTCouguxDKPHmx9yFuVbg27jrucrpEA0iKs46xCUdYltV1-eLitRRF1afJVHCUe491fVdHyAWOrztPilKyDEDbm5gy1i5J4R38C9bbcahin1M0FU_sl8tTD1VGJ-EDSShY1eiKRYVQYiPybPPoBe_dsGBDT_8UzYzYM Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:04:28.977684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5433b5d7443545249b9329f1ce9e3e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 5433b5d7443545249b9329f1ce9e3e02 Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-DeleteServersTestJSON-497972720 Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: b095ab3c72b14c67adf61ab4189e4892 Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-DeleteServersTestJSON-497972720-project Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.978956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '91c0da64-b54d-4cd3-b37b-2319dca6a6df'} Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:28.979637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. Aug 17 20:04:28.980783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:04:28.981807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] Returning 404 to user: Instance 91c0da64-b54d-4cd3-b37b-2319dca6a6df could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:28.981807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8a166eee-288b-4383-92e1-b394828eace1 tempest-DeleteServersTestJSON-497972720 tempest-DeleteServersTestJSON-497972720-project] 10.222.0.18 "GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df" status: 404 len: 111 microversion: 2.1 time: 0.029455 Aug 17 20:04:28.981807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 145/275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:28 2022] GET /compute/v2.1/servers/91c0da64-b54d-4cd3-b37b-2319dca6a6df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:29.068789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:29.069341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:29.076335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:29.076816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:29.077445 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:29.078183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:29.078619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:29.079044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:29.408061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:29.416844 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cc236cd6-5334-4d48-8138-f091b88c9f46 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.352384 Aug 17 20:04:29.417696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 131/276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:29 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:29.523864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:29.524645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:29.531083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:29.531711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:29.532135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:29.532833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:29.533281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:29.533848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:29.817941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:29.825699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d7246dbe-e68b-4631-b125-e1c12a9296dc tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.305526 Aug 17 20:04:29.826172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 146/277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:29 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:30.437439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:30.438104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:30.445123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:30.445779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:30.446277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:30.447054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:30.447565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:30.448043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:30.467089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:30.669076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:30.677921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0dc027f9-4246-477a-ad5a-e4e3425301da tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.244369 Aug 17 20:04:30.678493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 132/278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:30 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:30.847054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:30.847921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:30.854010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:30.854629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:30.855068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:30.855796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:30.856244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:30.856661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:31.272129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:31.284918 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-67815c3a-25b9-4fac-abb6-2ddf51d365dd tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.441410 Aug 17 20:04:31.291762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 147/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:30 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:31.703484 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:31.704283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:31.710619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:31.711101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:31.711526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:31.715940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:31.716416 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:31.716847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:32.034611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:32.045395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c46a3f2a-a804-42ff-9401-b3af2dd70baa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.349521 Aug 17 20:04:32.047661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 133/280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:31 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:32.308794 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:32.309483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:32.315718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:32.316267 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:32.316852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:32.317788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:32.318459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:32.318932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:32.496848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:32.504887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-57d32bb3-6206-450d-861d-1467c57206f0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.201169 Aug 17 20:04:32.505741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 148/281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:32 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:33.078929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:33.080459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:33.087765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:33.088321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:33.088763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:33.089515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:33.090018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:33.090435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:33.241475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:33.249925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-11ad4473-b5d1-4583-aaa7-3e898acb8728 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.177311 Aug 17 20:04:33.251042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 134/282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:33 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:33.526395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:33.527224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:33.534615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:33.535090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:33.535570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:33.536442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:33.537072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:33.537482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:33.688547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:33.696519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8f1bb7da-4c54-450f-8c6b-724c862b125d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.174221 Aug 17 20:04:33.697076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 149/283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:33 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:34.270186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:34.270903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:34.272957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.274010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.280368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:34.280990 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:34.281732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:34.282700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:34.283380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:34.283896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:34.434423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:34.443123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5d924237-845d-4418-8dcf-8d6b0d320efa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.176813 Aug 17 20:04:34.444177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 135/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:34 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:34.720025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:34.720729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:34.724487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.729513 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:34.730175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:34.730760 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:34.731688 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:34.732268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:34.732807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:34.866383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:34.877974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e8e3decd-5079-466c-ba84-7552ee528f76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.163105 Aug 17 20:04:34.878769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 150/285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:34 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:35.318514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122a24d7-a76a-4bbf-b53d-3e2715fb8f2c", "name": "network-vif-plugged", "status": "completed", "tag": "2a37a6b3-740b-4999-95c8-73b6238dc581"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:35.328767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:35.329364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:35.329852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:35.341128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] Creating event network-vif-plugged:2a37a6b3-740b-4999-95c8-73b6238dc581 for instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c on hv-cinder-82002 Aug 17 20:04:35.346054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-5bd29b75-82bb-4809-a669-ae688dff4e3a req-e540d7c1-a89a-46f2-8a90-6c8490f231a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Aug 17 20:04:35.346814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 136/286] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:35.464928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:35.465622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:35.471873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:35.472346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:35.472764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:35.473442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:35.473914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:35.474324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:35.625383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:35.633124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0e6d0b9e-f0da-40ba-b36b-6ca425ef8b3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.172291 Aug 17 20:04:35.633896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 151/287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:35 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:35.906925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:35.907619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:35.914301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:35.914838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:35.915273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:35.915971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:35.916400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:35.916828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:36.050053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:36.061091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-daf9f94d-e216-4d14-a058-0b1208ac39f2 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.158527 Aug 17 20:04:36.062076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 137/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:35 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:36.653701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:36.654312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:36.660934 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:36.661419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:36.661877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:36.662633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:36.663082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:36.663490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:36.805396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:36.813127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f835b54d-994a-49b0-bb07-ac700e485873 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.163577 Aug 17 20:04:36.813708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 152/289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:36 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:37.084246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:37.084790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:37.091320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:37.091798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:37.092406 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:37.093100 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:37.093565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:37.094145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:37.235645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:37.243686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ab9e6a01-3935-4547-abd2-67085ce72e5f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.163400 Aug 17 20:04:37.244254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 138/290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:37 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:37.781274 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3d3bb1b5-fc0f-49cd-b15a-c49a2f7b3d7d tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaad519c10>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:37.830715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3d3bb1b5-fc0f-49cd-b15a-c49a2f7b3d7d tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5419542f-df7e-4fc6-814c-d07b25641329" status: 200 len: 351 microversion: 2.1 time: 0.053159 Aug 17 20:04:37.831414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 153/291] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:04:37 2022] GET /compute/v2.1/os-volumes/5419542f-df7e-4fc6-814c-d07b25641329 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:37.836584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:37.837526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:37.844304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:37.844793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:37.845214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:37.845938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:37.846386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:37.846800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:37.982832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:37.991041 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa792d2e-0a94-4a2b-8af3-1293940fbe2c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.160861 Aug 17 20:04:37.991766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 139/292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:37 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:38.264105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:38.264705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:38.270714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:38.271188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:38.271616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:38.272287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:38.272737 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:38.273147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:38.402253 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:38.413903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f6d17ab8-6ccb-4a72-af73-707518ff74ce tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.153296 Aug 17 20:04:38.414732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 154/293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:38 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:39.017649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:39.018463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:39.029254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:39.030081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:39.030802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:39.031920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:39.032666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:39.033356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:39.309825 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:39.317385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-465b369d-f10a-4fa2-85e5-3bb55035f785 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.306418 Aug 17 20:04:39.318051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 140/294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:39 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:39.440575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:39.441271 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:39.447497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:39.447971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:39.448401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:39.449078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:39.449525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:39.449992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:39.589382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:39.596917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1a1d59fe-1af9-47fc-b420-adcb08d149e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1314 microversion: 2.1 time: 0.161132 Aug 17 20:04:39.597487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 155/295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:39 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:40.246759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-483dfdfb-cc73-432a-9ba0-b5e4bf678ea6 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacd04670>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:40.295684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-483dfdfb-cc73-432a-9ba0-b5e4bf678ea6 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/da57a8a4-ed58-4710-a956-f22a7050299c" status: 200 len: 351 microversion: 2.1 time: 0.052770 Aug 17 20:04:40.296247 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 141/296] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:04:40 2022] GET /compute/v2.1/os-volumes/da57a8a4-ed58-4710-a956-f22a7050299c => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:40.338649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:40.339461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:40.348241 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:40.348734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:40.349162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:40.350067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:40.350520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:40.350939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:40.535229 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:40.543778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-af084d49-05dc-48a5-b877-1d6fbcc07e8d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1523 microversion: 2.1 time: 0.209267 Aug 17 20:04:40.558785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 156/297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:40 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:40.616852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:40.618066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:40.620836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:40.633962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:40.634914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:40.635518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:40.636412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:40.636956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:40.637463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:40.782987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:40.790818 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-404f4d3a-3e4e-4d66-940e-85d96445e2e5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1498 microversion: 2.1 time: 0.177682 Aug 17 20:04:40.791540 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 142/298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:40 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:41.571821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.572407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:41.579357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.579945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.580403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.581098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.581557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.581993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.586257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.698302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-46011df3-27f5-4440-b319-b7ec6d2674b1 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacdacb80>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.727217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:41.735214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0849e287-b4a7-4aea-9603-128b25aa755f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1503 microversion: 2.1 time: 0.167273 Aug 17 20:04:41.735793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 157/299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:41.749995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-46011df3-27f5-4440-b319-b7ec6d2674b1 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3aa9167-db77-4456-b047-a43c0a4518d7" status: 200 len: 350 microversion: 2.1 time: 0.054957 Aug 17 20:04:41.751765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 143/300] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/os-volumes/b3aa9167-db77-4456-b047-a43c0a4518d7 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:41.756381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.757035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:41.765620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-211473ff-2165-48bb-a5b7-d339c57dcb9f tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacfddf70>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.774865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.775423 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.775853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.776553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.776999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.777436 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.879304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-211473ff-2165-48bb-a5b7-d339c57dcb9f tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.117492 Aug 17 20:04:41.879869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 144/301] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:41.894396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-011cad65-f838-47a6-b6a0-d7babe2ccdaf tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacdf04c0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.926534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:41.934375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1136e321-3fbc-4d22-86d0-64ca9c84c3e4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1516 microversion: 2.1 time: 0.183004 Aug 17 20:04:41.934931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 158/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:41.949928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:41.950446 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:41.956554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.957031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.957456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.958167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:41.958608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:41.959019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:41.983840 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:04:41.987636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-011cad65-f838-47a6-b6a0-d7babe2ccdaf tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097996 Aug 17 20:04:41.988356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 145/303] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:42.001278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b92952dc-51b8-4b55-99f9-474aae7002a9 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacd04160>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.083746 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b92952dc-51b8-4b55-99f9-474aae7002a9 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086102 Aug 17 20:04:42.084464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 146/304] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 17 20:04:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:42.099209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-03573f9f-5f69-4d26-a814-72861aece419 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "DELETE /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 204 len: 0 microversion: 2.1 time: 0.152380 Aug 17 20:04:42.099933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e73226b2-6163-4f9e-a802-d2ce19a51cd9 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacdac040>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.104731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 159/305] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:04:41 2022] DELETE /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 20:04:42.111166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.111970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:42.121496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:42.122015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:42.122494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:42.123215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:42.123629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:42.124295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:42.194917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e73226b2-6163-4f9e-a802-d2ce19a51cd9 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099660 Aug 17 20:04:42.196605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 147/306] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:42.210132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f90f89f-815f-49e9-b9d2-be0ed2e5092b tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaace9a430>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.321776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f90f89f-815f-49e9-b9d2-be0ed2e5092b tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115588 Aug 17 20:04:42.322528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 148/307] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:42.335951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa033856-813a-4b8e-a5ae-11c9d5eb6276 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacdac040>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.415983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa033856-813a-4b8e-a5ae-11c9d5eb6276 tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083955 Aug 17 20:04:42.416729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 149/308] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:42.419668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:42.427981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8a9e15bc-549a-48c0-8210-0559a1d5be49 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1504 microversion: 2.1 time: 0.321611 Aug 17 20:04:42.428678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 160/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:42.429490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e5f26747-01b1-46fb-8e30-78b51517080d tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaacd04160>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.518631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e5f26747-01b1-46fb-8e30-78b51517080d tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092708 Aug 17 20:04:42.519202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 150/310] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:42.532188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4239b684-c198-42f8-9d41-e88e50aeaebd tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] Calling method '.version_select at 0x7faaad5c40d0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:42.617290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4239b684-c198-42f8-9d41-e88e50aeaebd tempest-VolumesTestJSON-1057628038 tempest-VolumesTestJSON-1057628038-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088544 Aug 17 20:04:42.617904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 161/311] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 17 20:04:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:43.453805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:43.454390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:43.463685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:43.464342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:43.464826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:43.465668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:43.466256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:43.466808 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:43.603499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:43.611363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d1d251a-ca72-4bc3-8fc3-e8c2eb67a86d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1504 microversion: 2.1 time: 0.165102 Aug 17 20:04:43.611930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 151/312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:43 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:44.637015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:44.638083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:44.648464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:44.648971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:44.649401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:44.650115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:44.650563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:44.650977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:44.791639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:44.801972 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f7ce552b-aaa7-4cd4-aa09-51cf64e80310 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1504 microversion: 2.1 time: 0.171450 Aug 17 20:04:44.802510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 162/313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:44 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:45.824193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:45.824852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:45.832499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:45.833064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:45.833576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:45.834365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:45.834883 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:45.835366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:45.967160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:45.977208 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c3cf86a2-1d23-4d84-b2ca-4d09d481c3c0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1504 microversion: 2.1 time: 0.157305 Aug 17 20:04:45.978077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 152/314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:45 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:46.999427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:46.999984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:47.006789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:47.007250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:47.007658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:47.008389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:47.008842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:47.009252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:47.156783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:47.164983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-eae4d9fa-6940-4866-9e85-b859d076517d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1504 microversion: 2.1 time: 0.169536 Aug 17 20:04:47.165791 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 163/315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:46 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:47.781130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122a24d7-a76a-4bbf-b53d-3e2715fb8f2c", "name": "network-vif-deleted", "tag": "2a37a6b3-740b-4999-95c8-73b6238dc581"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:47.794106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:47.794638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:47.795163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:47.808744 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] Creating event network-vif-deleted:2a37a6b3-740b-4999-95c8-73b6238dc581 for instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c on hv-cinder-82002 Aug 17 20:04:47.814858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c9d7143a-8cad-4bf9-9d28-ba594b4dd425 req-13ce9d57-f1cc-4880-9e58-5fb2d7d94e17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Aug 17 20:04:47.815530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 153/316] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:04:48.190944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:48.191925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:48.202779 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:48.203577 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:48.204284 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:48.205421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:48.206215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:48.206944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:48.240768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:48.241269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:48.241413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:48.250898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lazy-loading 'fault' on Instance uuid 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:04:48.283716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:48.291475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d5601abb-e70f-42c6-8697-78a598c41a83 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 200 len: 1304 microversion: 2.1 time: 0.107059 Aug 17 20:04:48.292123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 164/317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:48 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:49.316155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:49.317407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:49.324148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.324622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.325049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.325767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.326215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.326626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.341789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] HTTP exception thrown: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Request method failure captured: Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c HTTP/1.1 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_UnFeZ_drrRWe1x0FiAsuFNXNXE2YTL82JW8JNgG7M8H2kx_U-Ux-lqCjYHwDCxy1Pa-WlzLyI7vBh6NrSJh7Fl8t5lhWSF7R-RujoVvoNcRgKveH5dJUFS9tfYbXhscKqkV3nwABrDnl_G91gPJJJ-2kN--PN4Q7Jq_vfXulungFco Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 04042df62e7941d7a6d9d1cf493d9602 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesActionsTest-1638655819 Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:04:49.343448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesActionsTest-1638655819 Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 04042df62e7941d7a6d9d1cf493d9602 Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesActionsTest-1638655819 Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesActionsTest-1638655819-project Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 1e6508646820461591015314de163c2f Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesActionsTest-1638655819-project Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. Aug 17 20:04:49.344998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '122a24d7-a76a-4bbf-b53d-3e2715fb8f2c'} Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:04:49.348845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. Aug 17 20:04:49.350053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:04:49.351088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Returning 404 to user: Instance 122a24d7-a76a-4bbf-b53d-3e2715fb8f2c could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:04:49.351088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5787750d-08cb-402a-83b9-88d417707da0 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c" status: 404 len: 111 microversion: 2.1 time: 0.033597 Aug 17 20:04:49.351088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 154/318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:49 2022] GET /compute/v2.1/servers/122a24d7-a76a-4bbf-b53d-3e2715fb8f2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:04:49.450286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2062298940", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "networks": [{"uuid": "89d5a6c5-1fb3-4067-b5ce-52db0e0bfe2f"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:49.503339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] validate_networks() for [('89d5a6c5-1fb3-4067-b5ce-52db0e0bfe2f', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:04:49.758717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:49.761024 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:49.767762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.768280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.768710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.769400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.769879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.770302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.793267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lazy-loading 'flavor' on Instance uuid 2ce34927-ae61-472f-b875-805b71bd8c12 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:04:49.864135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:04:49.865310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:04:49.865804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:04:49.866205 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:04:49.866605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:04:49.875865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.876324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.876739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.877445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.877914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.878325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.897661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Getting quotas for project 04042df62e7941d7a6d9d1cf493d9602. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:04:49.902718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Getting quotas for user 1e6508646820461591015314de163c2f and project 04042df62e7941d7a6d9d1cf493d9602. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:04:49.911001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-43901d92-14b5-48ee-be4d-2158a61d7a3c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/action" status: 200 len: 32 microversion: 2.1 time: 0.156825 Aug 17 20:04:49.912040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 155/319] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:04:49 2022] POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:04:49.921842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:04:49.922194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:49.923336 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:49.924819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:04:49.931184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.931758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.932401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.933118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:49.933640 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:49.934274 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:49.970572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d29f6de0-0dd6-45ee-ae82-64983f8a59d6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524712 Aug 17 20:04:49.976987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 165/320] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:04:49.982101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dbb5d560-14de-4573-962b-d4488e32b48f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:49.982734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dbb5d560-14de-4573-962b-d4488e32b48f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:50.055609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dbb5d560-14de-4573-962b-d4488e32b48f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:50.065970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dbb5d560-14de-4573-962b-d4488e32b48f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1214 microversion: 2.1 time: 0.087461 Aug 17 20:04:50.067251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 166/321] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:49 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:50.139955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:50.148404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-94f1c4c1-1e0d-4d7e-872c-3cb7b5073555 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.230755 Aug 17 20:04:50.149378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 156/322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:49 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:51.090038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:51.090572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:51.092502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:51.098286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:51.098765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:51.099232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:51.099925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:51.101016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:51.101465 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:51.171381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:51.172020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:51.174422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:51.179440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:51.180492 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:51.181365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:51.182557 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:51.183400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:51.184176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:51.185695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-82098ddc-5ab2-4f13-86f4-428e44a98b2a tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1266 microversion: 2.1 time: 0.100985 Aug 17 20:04:51.190163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 167/323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:51 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:51.328956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:51.341044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9457825f-4642-4703-8df8-d5811cd879f3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.174091 Aug 17 20:04:51.341833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 157/324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:51 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:52.206706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:52.207981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:52.214501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:52.215040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:52.215535 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:52.216304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:52.216749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:52.217200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:52.363460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:52.365319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:52.370357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:52.372858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:52.373339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:52.373795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:52.374499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:52.374966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:52.375355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:52.379312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-da07d05a-a9bb-4135-a5a0-a803a8567c1d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.176634 Aug 17 20:04:52.379665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:52.380783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 168/325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:52 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:52.552891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:52.561401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f7613d6f-775e-44c7-bfe7-c0f85160648c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.201810 Aug 17 20:04:52.562321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 158/326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:52 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:52.710636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6fc47b-31f1-4af6-b56d-454ae6b5242d", "tag": "39349ef0-a3cd-46da-8dd9-13430bfac403"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:04:52.728124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:52.728834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:52.729367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:52.742867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] Creating event network-changed:39349ef0-a3cd-46da-8dd9-13430bfac403 for instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d on hv-cinder-82002 Aug 17 20:04:52.749172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-b7a7914a-4774-41ff-8ff1-958edf769c31 req-067b5563-3c29-4ddf-ab1b-6f021843bcb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043848 Aug 17 20:04:52.751026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 169/327] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:04:53.401746 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:53.402337 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:53.409202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:53.409702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:53.410120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:53.411080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:53.411227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:53.411962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:53.577832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:53.587404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e0ba4507-c141-4bbd-b665-3c22b5b173c8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.189903 Aug 17 20:04:53.588281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 159/328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:53 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:53.590290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:53.590994 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:53.597527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:53.598032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:53.598475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:53.599166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:53.599609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:53.600041 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:53.728390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:53.735844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f2d4f720-8a16-46dc-ba12-b00f298b025f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.152693 Aug 17 20:04:53.736404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 170/329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:53 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:54.608290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:54.608895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:54.618835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:54.619482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:54.619907 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:54.620756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:54.621353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:54.621800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:54.756808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:54.757622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:54.766417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:54.771721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:54.775598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:54.776174 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:54.776928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:54.777393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:54.777846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:54.782514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b090508-88b6-4a0e-b6fd-2209589b76c5 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.177962 Aug 17 20:04:54.783095 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 160/330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:54 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:54.941835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:54.950921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-375a24bf-4304-425c-a85d-b0549908b446 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.198523 Aug 17 20:04:54.952243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 171/331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:54 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:55.804243 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:55.804870 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:55.811466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:55.812002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:55.812428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:55.813117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:55.813569 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:55.814013 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:55.973506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:55.974299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:55.982582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:55.983126 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:55.983549 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:55.984244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:55.984694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:55.985104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:56.216966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:56.224936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1b57a89b-42b0-4dc3-8d2f-4a9688bcdc0f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.424622 Aug 17 20:04:56.237692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 161/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:55 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:56.262029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:56.272696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bee7f405-6b33-4b77-9e95-092ccd54ec9f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.304014 Aug 17 20:04:56.273276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 172/333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:55 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:57.248052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:57.248622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:57.255043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:57.255530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:57.255948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:57.256633 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:57.257091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:57.257492 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:57.293192 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:57.293827 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:57.300798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:57.301286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:57.301744 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:57.302449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:57.302896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:57.303315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:57.527371 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:57.535052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b0f4aa6a-7442-4b6c-801c-4945f68f04b6 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.290919 Aug 17 20:04:57.535664 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 162/334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:57 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:57.572384 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:57.580905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b51020b5-4803-45b8-b2b9-357ec7d5b331 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.291591 Aug 17 20:04:57.581455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 173/335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:57 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:04:58.557028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:58.557663 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:58.563976 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:58.564545 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:58.564983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:58.565711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:58.566994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:58.567426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:58.601654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:58.602837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:58.611003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:58.611597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:58.612529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:58.613281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:58.614099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:58.614735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:58.747328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:58.756813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eee10270-35dd-44a1-a766-f9e903118ed3 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.203918 Aug 17 20:04:58.757651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 163/336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:58 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:58.778547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:58.786200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-762a777d-7a73-4d0f-9bbc-9750edd3158d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.188426 Aug 17 20:04:58.786767 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 174/337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:58 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:04:59.778304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:59.779046 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:59.785384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:59.788245 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:59.788761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:59.789391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:59.789898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:59.790925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:59.808690 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:04:59.809313 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:04:59.815810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:59.816295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:59.816723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:59.817415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:04:59.817901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:04:59.818468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:04:59.822983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:59.891186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:59.985383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:04:59.994381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cdf4c000-1ae4-4ce0-99fe-8a75cd262157 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.219969 Aug 17 20:04:59.994961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 164/338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:59 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:00.014419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:00.021813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-39decfc5-3828-4a81-b1ea-3583259b3914 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.217258 Aug 17 20:05:00.031108 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 175/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:04:59 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:01.015568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:01.016166 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:01.025453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:01.025965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:01.026373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:01.027060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:01.027700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:01.028117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:01.044366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:01.044994 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:01.047182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=8 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:01.054588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:01.055160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:01.055602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:01.056429 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:01.056883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:01.057657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:01.235841 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:01.246993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8fbe46a5-69bc-4f5f-bd4d-98cc46a4366d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.235174 Aug 17 20:05:01.248088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 165/340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:01 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:01.263997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:01.273395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ce823f46-de60-4d6e-aff8-43f3f70a4ee0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.233441 Aug 17 20:05:01.274008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 176/341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:01 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:01.706193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6fc47b-31f1-4af6-b56d-454ae6b5242d", "name": "network-vif-plugged", "status": "completed", "tag": "39349ef0-a3cd-46da-8dd9-13430bfac403"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:01.720852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:01.721293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:01.721914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:01.741365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] Creating event network-vif-plugged:39349ef0-a3cd-46da-8dd9-13430bfac403 for instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d on hv-cinder-82002 Aug 17 20:05:01.757351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a2ac1620-2c83-4116-904f-3353e82f946b req-fc20dce0-746c-4329-8280-c03011e59701 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057209 Aug 17 20:05:01.758738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 166/342] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:02.267337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:02.267939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:02.274489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:02.275233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:02.275659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:02.276352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:02.276793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:02.277211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:02.296060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:02.296739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:02.303713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:02.304351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:02.305111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:02.306078 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:02.306504 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:02.307176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:02.486887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:02.495022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-aa269b9a-13b6-4b16-82d8-7670d122763d tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.231599 Aug 17 20:05:02.508193 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 177/343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:02 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:02.508392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:02.515104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a019797c-3056-4e99-b948-dd1e11f47f6f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.223721 Aug 17 20:05:02.515703 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 167/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:02 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:03.515307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:03.515936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:03.522236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:03.522708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:03.523135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:03.523862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:03.524299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:03.524753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:03.536748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:03.538082 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:03.549805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:03.550613 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:03.551276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:03.552376 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:03.553227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:03.553861 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:03.753812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:03.759875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:03.768056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa44e0f7-4d4f-4bed-8d15-2a76be2b4e75 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.235502 Aug 17 20:05:03.769778 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 168/345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:03 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:03.769898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dfc68c59-a210-4a84-8cf9-3efc90f7adf8 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.256147 Aug 17 20:05:03.771158 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 178/346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:03 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:04.791142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:04.791866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:04.796820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:04.797415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:04.799055 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:04.799636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:04.800153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:04.800928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:04.801477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:04.802045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:04.804645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:04.805088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:04.805733 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:04.806754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:04.807173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:04.807608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:05.004156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:05.008131 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:05.012065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c2e10e06-b126-41ce-81a4-c6ef8e052650 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.224720 Aug 17 20:05:05.012678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 169/347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:04 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:05.016034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-516625d5-20d0-4070-a4a9-4bdb144923d1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.223693 Aug 17 20:05:05.016593 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 179/348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:04 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:06.035905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:06.036446 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:06.036797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:06.037136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:06.042969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:06.043435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:06.043547 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:06.043855 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:06.044123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:06.044542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:06.044647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:06.045011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:06.045422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:06.045555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:06.046074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:06.046559 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:06.241068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:06.244776 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:06.249382 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f408a5a2-c8ed-494c-9cb3-175c678c2a76 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.218927 Aug 17 20:05:06.250046 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 170/349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:06 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:06.253331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7813eec0-8b93-4ef6-88bb-cd594fbbc94a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.220865 Aug 17 20:05:06.253921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 180/350] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:06 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:07.272270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:07.272901 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:07.273825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:07.274427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:07.281321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:07.281786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:07.282209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:07.282905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:07.283368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:07.283758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:07.288611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:07.289102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:07.289526 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:07.290242 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:07.290683 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:07.291095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:07.518663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:07.522270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:07.528167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9d442002-c5ff-4fb4-a893-7fdd3f74465c tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.258040 Aug 17 20:05:07.528947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 181/351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:07 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:07.530408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e1dcd4f4-9979-4812-8a94-f31955de64a9 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1314 microversion: 2.1 time: 0.263928 Aug 17 20:05:07.530966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 171/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:07 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:08.555046 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:08.559785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:08.560880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:08.561809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:08.575286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:08.576269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:08.579020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:08.580058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:08.580415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:08.581106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:08.581797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:08.582468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:08.583415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:08.584606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:08.587001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:08.587667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:08.873896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:08.878674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:08.881844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-90bdcc70-edf4-46df-81b3-450cd6bd8776 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.336103 Aug 17 20:05:08.891906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-57498b51-8332-496c-a661-51490825fa9f tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1498 microversion: 2.1 time: 0.340164 Aug 17 20:05:08.893378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 182/353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:08 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:08.896895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 172/354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:08 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:09.731407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:09.733186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:09.751238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.752245 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.752775 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:09.753783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.754426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.755171 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:09.782018 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:05:09.868187 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d73d06b2-b4ca-4e98-aed8-4808527a4f78 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 204 len: 0 microversion: 2.1 time: 0.144125 Aug 17 20:05:09.868927 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 183/355] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:05:09 2022] DELETE /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:05:09.877240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:09.877891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:09.884553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.885028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.885458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:09.886202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.886649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.887062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:09.905854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:09.906726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:09.913657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.914285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.914846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:09.915672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:09.916196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:09.916681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:10.118899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:10.122312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:10.129774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3c59128f-c665-4899-9599-08ca84f00d0d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.229618 Aug 17 20:05:10.131801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 184/356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:09 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:10.140838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ae29f028-9199-4541-9ead-9ddaabfc83ff tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1504 microversion: 2.1 time: 0.267190 Aug 17 20:05:10.141442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 173/357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:09 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:11.155185 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:11.155803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:11.164537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:11.165559 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:11.166259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:11.167032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:11.167333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:11.168502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:11.168968 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:11.169385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:11.177048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=48 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:11.183147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:11.183147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:11.183147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:11.183147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:11.183531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:11.183975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:11.466229 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:11.473921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:11.476538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d8945324-1094-4101-b290-2870453feb93 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.325753 Aug 17 20:05:11.481938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8fb5ba17-2b79-45e0-833e-394966ebc634 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1504 microversion: 2.1 time: 0.321614 Aug 17 20:05:11.483889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 174/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:11 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:11.490361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 185/359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:11 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:12.509386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:12.512425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:12.514688 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:12.516566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:12.521805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:12.522320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:12.522818 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:12.523523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:12.523971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:12.524384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:12.532882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:12.533494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:12.534106 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:12.534882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:12.535393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:12.535866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:12.548903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:12.801025 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:12.816751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:12.829314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7f22c248-b61d-45eb-93e3-db08783809e1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.319480 Aug 17 20:05:12.830303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5049292d-56b9-4aa0-a123-b561a5c73d51 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1504 microversion: 2.1 time: 0.329052 Aug 17 20:05:12.838590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 175/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:12 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:12.842011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 186/361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:12 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:13.864753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:13.865360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:13.865573 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:13.866194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:13.872547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:13.872832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:13.873380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:13.873789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:13.873914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:13.874498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:13.874629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:13.874989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:13.875191 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:13.875376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:13.876148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:13.876758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:13.987712 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6508646820461591015314de163c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04042df62e7941d7a6d9d1cf493d9602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:14.016637 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b34bfa44-23eb-4201-a877-a368fc5b4a05 tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 200 len: 1462 microversion: 2.1 time: 0.155732 Aug 17 20:05:14.017555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 176/362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:13 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:14.022287 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6fc47b-31f1-4af6-b56d-454ae6b5242d", "name": "network-vif-deleted", "tag": "39349ef0-a3cd-46da-8dd9-13430bfac403"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:14.033832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.034537 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.035166 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.052512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] Creating event network-vif-deleted:39349ef0-a3cd-46da-8dd9-13430bfac403 for instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d on hv-cinder-82002 Aug 17 20:05:14.059246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-6d10acbc-c2a5-43e1-9303-71569ab0009f req-8acb834b-1e8d-4544-afa4-c3fe0d4855c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040453 Aug 17 20:05:14.060267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 177/363] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:14.094430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:14.105977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a38ec0b0-986c-4f8a-a5ed-2a717d798093 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1502 microversion: 2.1 time: 0.243313 Aug 17 20:05:14.107134 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 187/364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:13 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:14.129997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5845ae3-7a83-4ba2-a907-1aaf82cb3826"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:14.132974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:14.140093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.141005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.141703 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.144367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.145079 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.145756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.173576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] HTTP exception thrown: Cannot 'attach_volume' instance 2ce34927-ae61-472f-b875-805b71bd8c12 while it is in vm_state rescued Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Request method failure captured: Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/os-volume_attachments HTTP/1.1 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 74 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul1u0HN3oVR4RMY3Y3Cwi5A2gROomyi7Pi_hTbKDQYA_MRp7kiAx32AFB0ALGZyKk9lKXdsUowEfi26IaD7JWg1eUDRx3aOoyYhtWh--oqyrggBCO3BS1JOqkKY77Dw32XdudJqQtKW20QIbdjd63bWT9_vqQC6URXDSCDvKzbsFY4 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: db932807b4634440ba61a82446e82874 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:05:14.176021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/db932807b4634440ba61a82446e82874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_db932807b4634440ba61a82446e82874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: db932807b4634440ba61a82446e82874 Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: a5aece8a7f2342cfabd9a3f8707a4470 Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {"volumeAttachment": {"volumeId": "c5845ae3-7a83-4ba2-a907-1aaf82cb3826"}} Aug 17 20:05:14.177280 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Cannot 'attach_volume' instance 2ce34927-ae61-472f-b875-805b71bd8c12 while it is in vm_state rescued Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'server_id': '2ce34927-ae61-472f-b875-805b71bd8c12', 'body': {'volumeAttachment': {'volumeId': 'c5845ae3-7a83-4ba2-a907-1aaf82cb3826'}}} Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:05:14.178115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2ce34927-ae61-472f-b875-805b71bd8c12 while it is in vm_state rescued Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:05:14.179187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:05:14.180264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:05:14.180264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:05:14.180264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2ce34927-ae61-472f-b875-805b71bd8c12 while it is in vm_state rescued Aug 17 20:05:14.180264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:05:14.181432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Returning 409 to user: Cannot 'attach_volume' instance 2ce34927-ae61-472f-b875-805b71bd8c12 while it is in vm_state rescued {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:05:14.182511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6a49f41f-9787-417d-b63d-674a6de9a4dd tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057828 Aug 17 20:05:14.184030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 178/365] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:05:14 2022] POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 20:05:14.192254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:14.192789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:14.208838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.209341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.210861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.211598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.212056 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.212478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.348538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-057da10a-120d-4899-9ec8-5f21d1b168c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/action" status: 202 len: 0 microversion: 2.1 time: 0.159796 Aug 17 20:05:14.352317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 188/366] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:05:14 2022] POST /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:05:14.368288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:14.374033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:14.383586 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.384237 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.384756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.385521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:14.392360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:14.393244 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:14.552740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:14.560382 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8c02a30e-5999-4749-b8ad-0cb0a9ac2365 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.206660 Aug 17 20:05:14.560953 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 179/367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:14 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:15.041605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:15.042846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] [instance: ba6fc47b-31f1-4af6-b56d-454ae6b5242d] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:15.055319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:15.056015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:15.056512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:15.058015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:15.058659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:15.059132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:15.064811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:15.079228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] HTTP exception thrown: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Request method failure captured: Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d HTTP/1.1 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UnFeZ_drrRWe1x0FiAsuFNXNXE2YTL82JW8JNgG7M8H2kx_U-Ux-lqCjYHwDCxy1Pa-WlzLyI7vBh6NrSJh7Fl8t5lhWSF7R-RujoVvoNcRgKveH5dJUFS9tfYbXhscKqkV3nwABrDnl_G91gPJJJ-2kN--PN4Q7Jq_vfXulungFco Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 04042df62e7941d7a6d9d1cf493d9602 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesActionsTest-1638655819 Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:05:15.081499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/04042df62e7941d7a6d9d1cf493d9602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesActionsTest-1638655819 Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 04042df62e7941d7a6d9d1cf493d9602 Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesActionsTest-1638655819 Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesActionsTest-1638655819-project Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1e6508646820461591015314de163c2f Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesActionsTest-1638655819-project Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. Aug 17 20:05:15.083269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'ba6fc47b-31f1-4af6-b56d-454ae6b5242d'} Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:05:15.084103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. Aug 17 20:05:15.085432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:05:15.087474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] Returning 404 to user: Instance ba6fc47b-31f1-4af6-b56d-454ae6b5242d could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:05:15.088457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f83fb335-f489-4800-ac02-973c5372600b tempest-VolumesActionsTest-1638655819 tempest-VolumesActionsTest-1638655819-project] 10.222.0.18 "GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d" status: 404 len: 111 microversion: 2.1 time: 0.053985 Aug 17 20:05:15.089222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 189/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:15 2022] GET /compute/v2.1/servers/ba6fc47b-31f1-4af6-b56d-454ae6b5242d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:05:15.581393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:15.582595 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:15.591621 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:15.592344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:15.593002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:15.593928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:15.594348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:15.594997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:15.770453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:15.779539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6777e88d-81c7-4870-bd42-ac16a2714094 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.201673 Aug 17 20:05:15.782786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 180/369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:15 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:16.037969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1405785942", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "networks": [{"uuid": "4194b2e2-7faa-4753-a531-b2e77e07b207"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:16.104360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] validate_networks() for [('4194b2e2-7faa-4753-a531-b2e77e07b207', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:05:16.467308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:05:16.467716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:05:16.468180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:05:16.468611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:05:16.469141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:05:16.478401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:16.478901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:16.479362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:16.480074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:16.480520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:16.480936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:16.497550 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Getting quotas for project efac6ddeea0d4d458b7de89c533e540d. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:05:16.501649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Getting quotas for user 1fa6eb4bc1e54b6a80b038ea768d902c and project efac6ddeea0d4d458b7de89c533e540d. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:05:16.513258 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:05:16.515576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:05:16.561798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-54e856de-dd52-4c25-8d77-2fd32d0f037b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530891 Aug 17 20:05:16.562737 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 190/370] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:05:16.574603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c759ddba-8f44-47a0-bb3f-28ce6950f941 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:16.575226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c759ddba-8f44-47a0-bb3f-28ce6950f941 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:16.631828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c759ddba-8f44-47a0-bb3f-28ce6950f941 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:16.638822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c759ddba-8f44-47a0-bb3f-28ce6950f941 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1219 microversion: 2.1 time: 0.068572 Aug 17 20:05:16.639602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 181/371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:16 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:16.802357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:16.802978 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:16.809849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:16.810340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:16.810772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:16.811483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:16.811905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:16.812390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:16.965146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:16.972809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f6e53003-ce2a-486b-b852-a932f88bf894 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.174811 Aug 17 20:05:16.985854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 191/372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:16 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:17.659480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:17.660058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:17.668076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:17.668555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:17.668986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:17.669819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:17.670163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:17.670584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:17.736136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:17.743916 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-70599695-f5d1-40e4-844b-557708983f01 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1223 microversion: 2.1 time: 0.088291 Aug 17 20:05:17.744486 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 182/373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:17 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:17.996484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:17.997007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:18.005210 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:18.005813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:18.006344 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:18.007114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:18.007658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:18.008133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:18.148072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:18.156044 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3048a1e2-4ab9-4136-98bd-1676a3c35604 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.164666 Aug 17 20:05:18.156601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 192/374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:17 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:18.769996 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:18.771123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:18.779740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:18.780212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:18.780632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:18.781326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:18.781860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:18.782396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:18.845663 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:18.853795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-27340722-d1cc-4e96-a719-2726b668a53d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1223 microversion: 2.1 time: 0.091218 Aug 17 20:05:18.854411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 183/375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:18 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:19.180422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:19.181028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:19.189817 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:19.190428 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:19.190985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:19.191905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:19.192493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:19.193040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:19.330128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:19.342093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dc8324dd-f042-49ff-a241-09afa95e23c6 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.168108 Aug 17 20:05:19.342898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 193/376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:19 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:19.875292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:19.875968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:19.884059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:19.884628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:19.885138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:19.886101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:19.886643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:19.887065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:19.950106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:19.961038 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8d4104a9-7d6e-44a0-bd8b-150e815a0307 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1223 microversion: 2.1 time: 0.090066 Aug 17 20:05:19.961888 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 184/377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:19 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:20.367644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:20.368704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:20.375801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:20.376278 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:20.376704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:20.377384 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:20.377860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:20.378280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:20.515636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:20.523258 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d125b994-9cc9-458b-ace1-34ea570a8e9d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.162036 Aug 17 20:05:20.523818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 194/378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:20 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:20.986662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:20.987554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:20.997409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:20.997965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:20.998401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:20.999081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:20.999520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:20.999931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:21.062227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:21.070374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-762cce30-cb0b-4321-b1ce-1e9627dd374a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1223 microversion: 2.1 time: 0.090628 Aug 17 20:05:21.070884 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 185/379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:20 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:21.544325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:21.544905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:21.546912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:21.552697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:21.553168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:21.553614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:21.554299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:21.554736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:21.555151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:21.690073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:21.697723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0443d190-ffba-4257-b1da-7b1ec44a37b4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1510 microversion: 2.1 time: 0.157359 Aug 17 20:05:21.698346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 195/380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:21 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:22.091967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:22.092548 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:22.104770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:22.105251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:22.105712 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:22.106416 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:22.109394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:22.109857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:22.184768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:22.192357 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-abb46d55-0a88-476c-b974-b63833b69841 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1271 microversion: 2.1 time: 0.105427 Aug 17 20:05:22.192924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 186/381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:22 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:22.729093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:22.729868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:22.741911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:22.742407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:22.742835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:22.743547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:22.746099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:22.746738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:22.950531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:22.962981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6a42f7aa-0dad-4ef8-82c1-486a0f1c101f tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1516 microversion: 2.1 time: 0.237957 Aug 17 20:05:22.963943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 196/382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:22 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:23.219050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:23.219782 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:23.225884 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:23.226363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:23.226789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:23.227478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:23.227922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:23.228334 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:23.294625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:23.307593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9cef66f7-af78-4051-b3ad-6a1def61b261 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1279 microversion: 2.1 time: 0.093384 Aug 17 20:05:23.308511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 187/383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:23 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:24.328209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:24.328797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:24.334980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:24.335456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:24.335884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:24.336573 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:24.337128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:24.337399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:24.401457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:24.410315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-26092e5f-0016-490d-8272-fdea02626ba7 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1279 microversion: 2.1 time: 0.085232 Aug 17 20:05:24.411032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 197/384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:24 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:25.434319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:25.435075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:25.444659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:25.445259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:25.445798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:25.446747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:25.447352 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:25.447991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:25.512392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:25.520377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1876703b-337b-4efb-ac43-01129010e5fa tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1279 microversion: 2.1 time: 0.092401 Aug 17 20:05:25.520912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 188/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:25 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:26.542535 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:26.543136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:26.546148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:26.546765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:26.550919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:26.551442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:26.551864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:26.552552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:26.552996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:26.553408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:26.617255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:26.625303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0fc08300-6eee-4bbd-813a-d035f75ed3e8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1279 microversion: 2.1 time: 0.086459 Aug 17 20:05:26.630900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 198/386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:26 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:27.646404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:27.647026 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:27.655302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:27.657670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:27.658853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:27.659503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:27.660900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:27.661559 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:27.662161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:27.809458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:27.818131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-92f94f72-fee9-44ed-80d4-036880a455ff tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.175897 Aug 17 20:05:27.819171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 189/387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:27 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:28.412915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2193bbfb-912a-48de-aaa7-188ef42960ed", "tag": "766b0e84-f0a8-416f-8e8d-59ad7827509c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:28.449252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:28.451336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:28.452866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:28.472532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] Creating event network-changed:766b0e84-f0a8-416f-8e8d-59ad7827509c for instance 2193bbfb-912a-48de-aaa7-188ef42960ed on hv-cinder-82002 Aug 17 20:05:28.489886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-43386021-0534-4945-b124-3cd2535b4788 req-388d185f-87df-4212-a74a-7556120085f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092083 Aug 17 20:05:28.490494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 199/388] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:28.734462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5479ed8c-3872-436e-a49b-0c3fedfd0100 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: .version_select at 0x7faaacfddb80>, body: {"keypair": {"name": "tempest-keypair-1931801825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWiQjeyAzGYoNJrQYTzSnFp3fIlZwvxAPGdYyTLcHmRLsDH+rO4I8HYnuPHu1NeUwzrvdyvxMY50qP38t0+R5++N4SYYq2ONm4lKB+5zIoRCIoyyHctMQo+QTLWD6Tptg=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:28.770594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-5479ed8c-3872-436e-a49b-0c3fedfd0100 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for project db932807b4634440ba61a82446e82874. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:05:28.780649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-5479ed8c-3872-436e-a49b-0c3fedfd0100 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for user a5aece8a7f2342cfabd9a3f8707a4470 and project db932807b4634440ba61a82446e82874. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:05:28.815105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5479ed8c-3872-436e-a49b-0c3fedfd0100 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084872 Aug 17 20:05:28.816847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 190/389] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:05:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:28.843470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:28.844352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:28.869773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:28.870488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:28.870925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:28.871632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:28.872076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:28.872498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:29.404701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:29.417302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-74ab7e67-4fb2-4e0f-b04e-0898f31b24f4 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.579504 Aug 17 20:05:29.419585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 200/390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:28 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:30.441802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:30.442469 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:30.450804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:30.451676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:30.452198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:30.453142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:30.453717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:30.454320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:30.719781 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:30.728618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d1e24707-9fd3-4513-be00-86cbd931cb83 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.290843 Aug 17 20:05:30.729225 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 191/391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:30 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:30.953612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2000417662", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9847bb8-3ad8-4f38-9815-0c15a509d918"}], "security_groups": [{"name": "tempest-securitygroup--192981438"}], "key_name": "tempest-keypair-1931801825", "user_data": "}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:31.067898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] validate_networks() for [('a9847bb8-3ad8-4f38-9815-0c15a509d918', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:05:31.527576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:05:31.527996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:05:31.528677 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:05:31.529243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:05:31.529836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:05:31.539937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:31.540486 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:31.541209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:31.542193 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:31.542786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:31.543348 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:31.562728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:05:31.572583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Getting quotas for user a5aece8a7f2342cfabd9a3f8707a4470 and project db932807b4634440ba61a82446e82874. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:05:31.587980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:05:31.590346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:05:31.657207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91dddadb-2aec-44cb-a2b9-71f231d7b97d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.708169 Aug 17 20:05:31.658588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 201/392] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:05:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:05:31.669350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d00f96c1-2ddf-4856-9c56-9687c32f0755 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:31.669990 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d00f96c1-2ddf-4856-9c56-9687c32f0755 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:31.743249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d00f96c1-2ddf-4856-9c56-9687c32f0755 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:31.755756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:31.756898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:31.771117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d00f96c1-2ddf-4856-9c56-9687c32f0755 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1246 microversion: 2.1 time: 0.105003 Aug 17 20:05:31.774042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 192/393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:31 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:31.785403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:31.785928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:31.786362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:31.787077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:31.787518 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:31.787937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:31.987907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:31.997900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-36b571af-2727-4add-a635-e2e509e43361 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.247513 Aug 17 20:05:31.999162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 202/394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:31 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:32.797711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:32.799526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:32.810404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:32.811025 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:32.811461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:32.812169 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:32.812623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:32.813044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:32.900601 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:32.910143 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ddbe3ba-3a14-4f32-93e3-b8aebf259de2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1250 microversion: 2.1 time: 0.117179 Aug 17 20:05:32.919779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 193/395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:32 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1250 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:33.018993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:33.019696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:33.026092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:33.026687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:33.027176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:33.028070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:33.028579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:33.029058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:33.192049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:33.201321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-906e42e5-6255-419e-a9cc-eea848168d3a tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.185661 Aug 17 20:05:33.202029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 203/396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:33 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:33.932396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:33.932999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:33.939670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:33.940142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:33.940569 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:33.941258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:33.941743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:33.942159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:34.004220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:34.012734 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f72815bd-8b6f-4acc-917e-5d51f8201815 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1250 microversion: 2.1 time: 0.084328 Aug 17 20:05:34.013861 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 194/397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:33 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:34.225570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:34.227214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:34.236774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:34.237781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:34.238879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:34.240293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:34.241092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:34.241920 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:34.434640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:34.442417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c06cd5e4-006c-4b12-be7d-654b3d835483 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.222362 Aug 17 20:05:34.442990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 204/398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:34 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:35.034574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:35.035298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:35.044567 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:35.045229 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:35.045813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:35.046874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:35.047375 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:35.048571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:35.115681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:35.123091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4ee44821-523a-4bb3-b301-43c87e5ad695 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1250 microversion: 2.1 time: 0.093216 Aug 17 20:05:35.123649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 195/399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:35 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:35.475644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:35.477030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:35.484367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:35.485075 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:35.485809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:35.486800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:35.487583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:35.488339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:35.738664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:35.752916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a9769416-b16d-4bb9-9fb0-1f4a6965b38b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.288771 Aug 17 20:05:35.778428 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 205/400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:35 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:36.145107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:36.145860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:36.159298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:36.159298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:36.159298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:36.159298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:36.161183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:36.164848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:36.186684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:36.283920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:36.299981 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-03038008-c420-446c-90b9-542c19eb4cc5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1250 microversion: 2.1 time: 0.159757 Aug 17 20:05:36.302063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 196/401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:36 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1250 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:36.778999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:36.779706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:36.786397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:36.786657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:36.790373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:36.792111 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:36.793730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:36.794379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:36.963988 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:36.972691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-676027c9-148a-408c-8853-43a5cdd1b834 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.197568 Aug 17 20:05:36.974070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 206/402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:36 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:37.323094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:37.324145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:37.338938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:37.340007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:37.340711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:37.351081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:37.359207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:37.359207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:37.504031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:37.526532 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-12c4dfb5-f96f-4f3a-8715-2f0d35bd79a3 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1298 microversion: 2.1 time: 0.207529 Aug 17 20:05:37.527130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 197/403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:37 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:37.994311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:37.995670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:38.002547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:38.003383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:38.004065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:38.004992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:38.005728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:38.006398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:38.194767 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:38.205073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ef0048fd-28f2-4268-8c96-3d40691349eb tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.214244 Aug 17 20:05:38.208549 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 207/404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:37 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:38.548754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:38.549420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:38.555756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:38.556521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:38.556950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:38.557713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:38.558400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:38.559197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:38.623181 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:38.634411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e91907ca-9d2c-43cf-8c5d-d57375eb6d35 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1304 microversion: 2.1 time: 0.090223 Aug 17 20:05:38.649104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 198/405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:38 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:39.232294 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:39.232951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:39.239817 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:39.240309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:39.240734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:39.242179 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:39.242651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:39.243266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:39.263758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:39.417096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:39.425922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8b0cf8bc-b18a-436f-a9c3-39ca8adc3b74 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.197437 Aug 17 20:05:39.426525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 208/406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:39 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:39.656201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:39.657747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:39.665471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:39.666039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:39.666695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:39.667552 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:39.668298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:39.668790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:39.740979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:39.752114 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4cffb324-8104-4ffb-844b-3b7314af4e55 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1304 microversion: 2.1 time: 0.099353 Aug 17 20:05:39.752990 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 199/407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:39 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:40.450533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:40.451124 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:40.457325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:40.458065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:40.458777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:40.459651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:40.460101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:40.460517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:40.625512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:40.634147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e67d765b-1f8d-4005-b122-73b120e5d2a9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.187644 Aug 17 20:05:40.635105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 209/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:40 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:40.775213 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:40.775840 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:40.782872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:40.783891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:40.784638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:40.785565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:40.786177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:40.786761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:40.859834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:40.867809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8959d997-8f3b-4e06-9146-9d87ec49e25d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1304 microversion: 2.1 time: 0.097271 Aug 17 20:05:40.868393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 200/409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:40 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:41.658187 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:41.659485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:41.661613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:41.662551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:41.668309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:41.668887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:41.669397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:41.670188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:41.670868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:41.671678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:41.822268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:41.831711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b100d3dc-a6db-4292-b94f-a0e486cda18f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.177096 Aug 17 20:05:41.832234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 210/410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:41 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:41.888673 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:41.889456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:41.891532 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:41.892801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:41.899799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:41.900297 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:41.900817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:41.901588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:41.902218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:41.902643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:41.974293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:41.978269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05e80725-db3e-4f60-94c8-64de30eef999 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1304 microversion: 2.1 time: 0.093595 Aug 17 20:05:41.989788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 201/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:41 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:42.852834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:42.853486 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:42.861617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:42.866657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:42.866657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:42.866657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:42.866657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:42.870398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:43.000970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:43.001853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:43.009093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:43.009753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:43.010365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:43.011234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:43.011827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:43.012388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:43.031105 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:43.040485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-966d9544-c49b-4040-8704-2503a79baa1e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.192809 Aug 17 20:05:43.041071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 211/412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:42 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:43.173905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:43.182541 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-51a2df8e-2fb5-4237-85aa-6a317dbd91f5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.186149 Aug 17 20:05:43.183117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 202/413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:42 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:43.830513 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:43.851530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:43.852184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:43.852772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:43.865531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] Creating event network-changed:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:05:43.885917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-33ab61c1-d7a2-4ce0-acf2-d96616ad4b3e req-fc1b4207-958a-433f-ab30-40d31449fa66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060421 Aug 17 20:05:43.887597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 212/414] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:44.060490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:44.061096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:44.068244 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:44.068748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:44.069352 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:44.070332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:44.070929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:44.071493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:44.204941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:44.205753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:44.215970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:44.216969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:44.217679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:44.219914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:44.235992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:44.238100 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:44.264341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:44.272514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7d647851-6f9d-4209-aa4c-49f16c7c5b45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.215810 Aug 17 20:05:44.274160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 203/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:44 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:44.405719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:44.413865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9e34a110-d3f5-4891-888e-7fa3915edeb8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.213696 Aug 17 20:05:44.414448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 213/416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:44 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:44.561327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2193bbfb-912a-48de-aaa7-188ef42960ed", "name": "network-vif-plugged", "status": "completed", "tag": "766b0e84-f0a8-416f-8e8d-59ad7827509c"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:44.571002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:44.571947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:44.572358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:44.585035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] Creating event network-vif-plugged:766b0e84-f0a8-416f-8e8d-59ad7827509c for instance 2193bbfb-912a-48de-aaa7-188ef42960ed on hv-cinder-82002 Aug 17 20:05:44.590400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c0bac9d7-231e-499f-ae33-5aafe018cc0c req-a0eb5f34-e1c8-4b51-bb58-4821df25f660 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032759 Aug 17 20:05:44.590926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 204/417] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:45.294567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:45.295141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:45.301982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:45.302462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:45.302889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:45.303568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:45.304095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:45.304510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:45.436696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:45.437419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:45.442306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:45.450478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e868bd10-8b03-4099-a27e-bd69040d973d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.159764 Aug 17 20:05:45.450672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:45.450952 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:45.451345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 214/418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:45 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:45.451481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:45.452268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:45.452709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:45.453116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:45.588318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:45.596172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d15332b2-35d0-44a8-bfd1-6bd9dff4d3a2 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.164224 Aug 17 20:05:45.596756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 205/419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:45 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:46.471576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:46.472286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:46.478501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:46.479057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:46.479404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:46.480300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:46.480746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:46.481293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:46.616066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:46.617196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:46.626584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:46.627335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:46.627954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:46.629493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:46.630379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:46.630642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:46.631485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:46.639453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-95b09692-244e-4ecd-a678-12414c922e9c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.171795 Aug 17 20:05:46.652584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 215/420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:46 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:46.786968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:46.794799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-65701f43-060b-4d22-a071-9dd8b1738f9a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.182380 Aug 17 20:05:46.795649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 206/421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:46 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:47.660558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:47.661141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:47.668002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:47.668482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:47.669006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:47.669877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:47.670468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:47.671043 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:47.815720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:47.816733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:47.818873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:47.825705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-667a6bb7-941b-40bb-8cb0-b99976085f8d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.168574 Aug 17 20:05:47.826450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:47.826918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:47.827576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:47.828652 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:47.829442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:47.831314 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:47.838569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 216/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:47 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:47.985397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:47.992890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e53f9f45-9b8e-46d4-a929-4b74cfb32a45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.180027 Aug 17 20:05:47.993495 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 207/423] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:47 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:48.847108 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:48.847711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:48.854521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:48.855011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:48.855439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:48.856202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:48.856592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:48.857012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:48.993342 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:49.001605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5cf40774-781c-4fd8-ae8a-f2395cef31e1 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1319 microversion: 2.1 time: 0.158449 Aug 17 20:05:49.002181 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 217/424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:48 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:49.014203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:49.015888 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:49.022827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:49.023532 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:49.024104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:49.028948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:49.028948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:49.028948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:49.176094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:49.183862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f90fedb-33f0-4c6b-bf6e-4168fd4cb5d7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.173995 Aug 17 20:05:49.184430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 208/425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:49 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:05:50.025990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:50.027024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:50.035681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:50.036213 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:50.036795 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:50.037985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:50.038723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:50.039411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:50.177859 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:50.185875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fecf59a0-cdb2-42de-a7f4-1cc0cbe92fb3 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1509 microversion: 2.1 time: 0.166304 Aug 17 20:05:50.186435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 218/426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:50 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:50.204587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:50.205196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:50.212076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:50.212563 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:50.212989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:50.213743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:50.214192 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:50.214620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:50.370010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:50.377969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cf1e0b81-5782-4928-98b0-d225a35d10b7 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.177317 Aug 17 20:05:50.378538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 209/427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:50 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:50.806566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "name": "network-vif-plugged", "status": "completed", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:50.818917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:50.819485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:50.820034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:50.832207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] Creating event network-vif-plugged:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:05:50.837577 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-6d200848-69a3-4693-8b7d-656b7ae0a28b req-affd426d-2858-4021-8122-7ea22fe91aa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Aug 17 20:05:50.838189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 219/428] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:05:51.399349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:51.399949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:51.406511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:51.406976 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:51.407399 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:51.408073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:51.408722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:51.409133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:51.551325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:51.558885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8f93fb32-7ad2-4e80-a1cc-7de83bc61325 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.163685 Aug 17 20:05:51.559588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 210/429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:51 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:52.581146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:52.581855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:52.583817 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:52.589464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:52.589959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:52.590382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:52.591062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:52.591503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:52.591914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:52.730717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:52.738614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-cfd473bb-d7c0-4551-9300-fdb669341a78 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1371 microversion: 2.1 time: 0.161846 Aug 17 20:05:52.739178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 220/430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:52 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:53.760189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:53.760801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:53.767602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:53.768232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:53.768672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:53.769389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:53.769866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:53.770284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:53.902086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:05:53.913156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e9dfe944-7476-41b3-ac8d-56ed904853ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1565 microversion: 2.1 time: 0.156621 Aug 17 20:05:53.913946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 211/431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:05:53 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:05:53.934537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:05:53.935094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:05:53.941839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:53.942314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:53.942735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:53.943409 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:53.943850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:53.944257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:54.024083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-253cd304-c125-4a48-9dc2-b015bc0a9dd8 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093306 Aug 17 20:05:54.024701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 221/432] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:05:53 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:05:55.225894 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:05:55.237096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:05:55.237577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:05:55.238008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:05:55.249853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] Creating event network-changed:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:05:55.255063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-22a6f49b-9bd8-4f0d-878f-7186f9b07b2e req-9bb681f6-edee-4d59-bc10-09ccc9da569b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Aug 17 20:05:55.255839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 212/433] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:21.304849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:21.305801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=70 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:21.310113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28fa9576-2479-4e2d-ab49-706fae729647", "device": "/dev/sdb"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:06:21.313010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:21.319718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:21.320125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:21.320561 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:21.321391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:21.321910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:21.322339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:21.666012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9411dbf8-1b45-440a-9dcf-9822ec81dbfd tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "POST /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361708 Aug 17 20:06:21.666637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 222/434] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:06:21 2022] POST /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:33.641198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=23 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:33.641988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=92 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:33.646872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:33.647433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:33.654536 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:33.655015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:33.655442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:33.656128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:33.656570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:33.656986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:33.680791 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4d0b0a29-ec39-410d-bc2a-2f9ca3a10dbc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/ips" status: 200 len: 149 microversion: 2.1 time: 0.041528 Aug 17 20:06:33.681343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 213/435] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:06:33 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:39.288849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:39.289652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:39.294252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1e91ae-26df-4fde-adf4-81074c7d9db8"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:06:39.296938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:39.304619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:39.305142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:39.305558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:39.306269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:39.306708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:39.307115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:43.833413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0b001392-c043-4b38-b237-c9d47be19ee6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.545785 Aug 17 20:06:43.834084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 223/436] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:06:39 2022] POST /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments => generated 194 bytes in 4547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:52.503086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c8ef7bc2-e585-4e87-8fcc-0c1f77a20c9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: .version_select at 0x7faaacf90040>, body: {"keypair": {"name": "tempest-keypair-210012068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfFUdP6P/qNb6L/+8TksMvJO76OGQp4L8nzx1lr/uP2WmZzBsNIk0XVbwpxgH0xICDCOULuyzwCySm+hoC/vLmNAJ4913932feIAvMrOjc7j4izQ4uBo1zwJ/21zIJVoQ=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:06:52.508410 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:52.509059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:52.521202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-c8ef7bc2-e585-4e87-8fcc-0c1f77a20c9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:06:52.525230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-c8ef7bc2-e585-4e87-8fcc-0c1f77a20c9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:06:52.550186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c8ef7bc2-e585-4e87-8fcc-0c1f77a20c9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051441 Aug 17 20:06:52.550773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 214/437] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:06:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:53.957787 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:53.958580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:06:53.963396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-933055809", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75cad640-8a23-42bc-b03e-d2829e6ee836"}], "security_groups": [{"name": "tempest-securitygroup--1087261177"}], "key_name": "tempest-keypair-210012068", "user_data": "}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:06:54.074803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] validate_networks() for [('75cad640-8a23-42bc-b03e-d2829e6ee836', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:06:54.464374 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:06:54.464971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:06:54.465607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:06:54.466148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:06:54.466736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:06:54.477566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:54.478090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:54.478523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:54.479247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:54.479668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:54.480089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:54.500785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:06:54.506669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:06:54.520992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:06:54.523519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:06:54.580160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ce06dbbf-e322-461c-b1d9-8ba18efa3bd3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623937 Aug 17 20:06:54.580810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 224/438] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:06:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:06:54.593562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-afb63e7c-39b3-4204-bc72-f5d7b0007109 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:54.594400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-afb63e7c-39b3-4204-bc72-f5d7b0007109 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:54.656565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-afb63e7c-39b3-4204-bc72-f5d7b0007109 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:54.664718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-afb63e7c-39b3-4204-bc72-f5d7b0007109 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1240 microversion: 2.1 time: 0.075706 Aug 17 20:06:54.665257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 215/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:54 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:06:55.689960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:55.690812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:55.697530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:55.697982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:55.698386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:55.699059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:55.699502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:55.699912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:55.767867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:55.776266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f626fa85-1829-4e51-9112-2d17ece85019 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1292 microversion: 2.1 time: 0.093527 Aug 17 20:06:55.776825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 225/440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:55 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:06:55.898920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:55.899459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:55.907176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:55.907666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:55.908086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:55.912057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:55.912057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:55.912057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:56.041716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lazy-loading 'services' on Instance uuid 2193bbfb-912a-48de-aaa7-188ef42960ed {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:06:56.159979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ef9f7da-3d3b-46a6-b31f-8b076bc64b8c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed/os-volume_attachments/28fa9576-2479-4e2d-ab49-706fae729647" status: 202 len: 0 microversion: 2.1 time: 0.265127 Aug 17 20:06:56.160574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 216/441] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:06:55 2022] DELETE /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed/os-volume_attachments/28fa9576-2479-4e2d-ab49-706fae729647 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:06:56.797959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:56.798629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:56.805966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:56.806444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:56.806870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:56.807545 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:56.807993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:56.808415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:56.876012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:56.883951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-657e0e9b-e8a9-4ec8-9b4a-1a3d09fbad69 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1298 microversion: 2.1 time: 0.090427 Aug 17 20:06:56.884514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 226/442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:56 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:06:57.906164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:57.906785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:57.913702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:57.914173 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:57.914593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:57.915268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:57.915690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:57.916098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.050607 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:58.058539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c0e0d8bb-b52f-45c1-b4b9-e6bb0289f1ae tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.157275 Aug 17 20:06:58.059142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 217/443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:57 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:06:58.368165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:58.368729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:58.376917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:58.377404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:58.377838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.378523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:58.379152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:58.379759 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.404991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:06:58.490991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9a7a6948-a4bb-447c-9962-d43d0c394f0c tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 204 len: 0 microversion: 2.1 time: 0.126076 Aug 17 20:06:58.491961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 227/444] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:06:58 2022] DELETE /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:06:58.500581 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:58.501561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:58.509988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:58.510824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:58.511526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.512435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:58.512943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:58.513800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.683751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:58.692634 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c0b42f17-d55f-414b-8381-3ff3fcde7a8f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1515 microversion: 2.1 time: 0.196003 Aug 17 20:06:58.697875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 218/445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:58 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:06:58.705687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958f5b11-f1b0-419c-9c9f-e7b3ee980ba6", "tag": "80f09e64-52f2-479d-82c3-f09657e6795c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:06:58.715949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:58.716636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:58.717336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:58.729306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] Creating event network-changed:80f09e64-52f2-479d-82c3-f09657e6795c for instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 on hv-cinder-82002 Aug 17 20:06:58.734755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-94da822a-1287-43b6-a602-9e315a634707 req-995889ec-bb38-443b-b5f7-896e78969d5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033245 Aug 17 20:06:58.735708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 228/446] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:06:59.079650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:59.080549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:59.088205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:59.088798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:59.089237 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:59.089970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:59.090553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:59.090982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:59.227510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:59.235303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b4190a15-02d4-4872-a805-ce45195b1fde tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.160053 Aug 17 20:06:59.235955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 219/447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:59 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:06:59.714993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:06:59.716362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:06:59.724125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:59.724602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:59.725025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:59.725742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:06:59.726218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:06:59.726655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:06:59.860833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:06:59.868857 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0f8ff767-bc44-4274-ab7e-2825c9e6306f tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1515 microversion: 2.1 time: 0.159043 Aug 17 20:06:59.872229 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:06:59 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:00.256179 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:00.256859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:00.263746 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:00.264290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:00.264754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:00.265510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:00.265993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:00.266412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:00.415491 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:00.427933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c423eb3c-fc37-4057-890c-3e0df22c8dca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.175655 Aug 17 20:07:00.428765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 220/449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:00 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:00.889912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:00.890496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:00.897358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:00.897868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:00.898295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:00.898993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:00.899425 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:00.899837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:01.045115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:01.056718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ed994187-18a0-4426-9b44-b2f9f7f4201b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1515 microversion: 2.1 time: 0.170294 Aug 17 20:07:01.057279 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 230/450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:00 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:01.452605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:01.453350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:01.460450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:01.460991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:01.461826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:01.462716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:01.463223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:01.463728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:01.635565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:01.650479 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2b521b1b-2df6-44ef-b3b5-9e2e602318b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.201951 Aug 17 20:07:01.651395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 221/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:01 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:02.078111 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:02.078687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:02.085853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:02.086332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:02.086761 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:02.087458 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:02.087902 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:02.088312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:02.157497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:02.165514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9dcbed8b-cf9e-4f11-9733-5658089ffde9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1473 microversion: 2.1 time: 0.091530 Aug 17 20:07:02.166355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 231/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:02 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:02.237444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2193bbfb-912a-48de-aaa7-188ef42960ed", "name": "network-vif-deleted", "tag": "766b0e84-f0a8-416f-8e8d-59ad7827509c"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:02.247389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:02.247850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:02.248261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:02.259506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] Creating event network-vif-deleted:766b0e84-f0a8-416f-8e8d-59ad7827509c for instance 2193bbfb-912a-48de-aaa7-188ef42960ed on hv-cinder-82002 Aug 17 20:07:02.264492 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-0c45b191-4b2d-4fd0-970b-cbd341e76faa req-4067d3cd-9739-426c-88ca-863f7904a754 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031102 Aug 17 20:07:02.265080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 222/453] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:02.671341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:02.671968 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:02.678669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:02.679159 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:02.679583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:02.680265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:02.680731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:02.681113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:02.812589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:02.820031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ac8d22f4-9da4-468b-9b89-b5ff4651c138 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.152737 Aug 17 20:07:02.820553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 232/454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:02 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:03.193087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:03.194154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:03.204674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:03.205442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:03.206349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:03.207080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:03.207544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:03.207965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:03.238647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:03.239117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:03.239539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:03.239978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lazy-loading 'fault' on Instance uuid 2193bbfb-912a-48de-aaa7-188ef42960ed {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:07:03.288656 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:03.296199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4927d8b7-625d-4939-80fa-b34ec126643b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1309 microversion: 2.1 time: 0.111331 Aug 17 20:07:03.296758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 223/455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:03 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:03.844585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:03.845606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:03.853023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:03.853504 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:03.853970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:03.854658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:03.855103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:03.855519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:03.994608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:04.002407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8ca98dc7-7e60-4ffc-99b3-ef9fbc4b72a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.164432 Aug 17 20:07:04.002976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 233/456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:03 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:04.321215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:04.321973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:04.331852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:04.332436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:04.332965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:04.333727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:04.334304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:04.334847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:04.369279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:04.369784 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:04.370205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:04.370637 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lazy-loading 'fault' on Instance uuid 2193bbfb-912a-48de-aaa7-188ef42960ed {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:07:04.421887 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:04.429796 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a13ed67b-6c1a-40fa-bec1-3e0bbf4cfd96 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1309 microversion: 2.1 time: 0.115134 Aug 17 20:07:04.430351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 224/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:04 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:05.025871 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:05.026504 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:05.028488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:05.029138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:05.035096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:05.035569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:05.035993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:05.036676 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:05.037116 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:05.037529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:05.176302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:05.183860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e5c289d4-6c7c-4fd8-bcd3-7142e2f16a9b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.163979 Aug 17 20:07:05.184494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 234/458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:05 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:05.450138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:05.450713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:05.452699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:05.458446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:05.458919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:05.459339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:05.460005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:05.460444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:05.460851 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:05.491762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:05.492223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:05.492647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:05.493072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lazy-loading 'fault' on Instance uuid 2193bbfb-912a-48de-aaa7-188ef42960ed {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:07:05.537398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:05.546077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8845e47c-5241-4a64-b973-2875c7178aef tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 200 len: 1309 microversion: 2.1 time: 0.099664 Aug 17 20:07:05.546659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 225/459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:05 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:06.204436 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:06.205040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:06.212009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:06.212488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:06.212917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:06.213867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:06.214314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:06.214715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:06.347903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:06.355730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6c258af8-8bb1-4afd-a678-0f0ead162e3e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.155173 Aug 17 20:07:06.356276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 235/460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:06 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:06.567153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:06.567819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 2193bbfb-912a-48de-aaa7-188ef42960ed] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:06.573932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:06.574420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:06.574848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:06.575542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:06.575992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:06.576437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:06.589877 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] HTTP exception thrown: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Request method failure captured: Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed HTTP/1.1 Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Un6Qjw_3MHSXB1Dzc7SQrSIxGwnV-yu4jmZwMQ_ZLdaSoE-ZJZGQ6a080Ku4XmDiupqGaXK1SNyLkCzys2Mi7jzD3InlF7xfYezpuPf_nTpR4wrN_bSN2WNaEcWgmeBJQm-soMa9WwshDa8ljU2JwHdvbACM22M_FwFtQEznGou2pw Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: efac6ddeea0d4d458b7de89c533e540d Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:07:06.591544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: efac6ddeea0d4d458b7de89c533e540d Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotTestJSON-86842674-project Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 1fa6eb4bc1e54b6a80b038ea768d902c Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotTestJSON-86842674-project Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. Aug 17 20:07:06.593056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '2193bbfb-912a-48de-aaa7-188ef42960ed'} Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:07:06.593985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. Aug 17 20:07:06.595461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:07:06.596857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Returning 404 to user: Instance 2193bbfb-912a-48de-aaa7-188ef42960ed could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:07:06.596857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-346abd50-4736-4d44-924b-590b6c67cef9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed" status: 404 len: 111 microversion: 2.1 time: 0.029948 Aug 17 20:07:06.596857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 226/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:06 2022] GET /compute/v2.1/servers/2193bbfb-912a-48de-aaa7-188ef42960ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:07:07.376354 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:07.376933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:07.383650 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:07.384127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:07.384557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:07.385243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:07.385746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:07.386166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:07.518880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:07.526675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ab6bd623-1a30-4668-a2c0-badd8f7ce475 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.154243 Aug 17 20:07:07.527413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 236/462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:07 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:08.547548 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:08.548135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:08.555310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:08.555790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:08.556216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:08.556896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:08.557343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:08.557803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:08.689373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:08.699398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5f9b7540-fc5f-405a-a20b-366e7e1081ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.155510 Aug 17 20:07:08.700103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 227/463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:08 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:09.722909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:09.723906 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:09.733586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:09.734234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:09.734833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:09.736013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:09.736127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:09.736616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:09.884528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:09.893979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-94819109-4192-4ef6-834b-bf2c9cbf8559 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.174954 Aug 17 20:07:09.894815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 237/464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:09 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:10.914571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:10.915159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:10.922555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:10.923007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:10.923664 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:10.924727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:10.925211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:10.925661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:11.060736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:11.068365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-651fa0d2-b005-4186-8ab9-9c3e768fb6be tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.157696 Aug 17 20:07:11.068924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 228/465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:10 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:12.099390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:12.100041 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:12.110464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:12.111542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:12.112463 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:12.113441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:12.114180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:12.114849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:12.248444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:12.256682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-42ed0b40-b57d-4a14-9af5-2b4a898a4fe8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.161769 Aug 17 20:07:12.257249 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 238/466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:12 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:13.093910 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958f5b11-f1b0-419c-9c9f-e7b3ee980ba6", "name": "network-vif-plugged", "status": "completed", "tag": "80f09e64-52f2-479d-82c3-f09657e6795c"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:13.104737 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:13.105264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:13.105669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:13.117050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] Creating event network-vif-plugged:80f09e64-52f2-479d-82c3-f09657e6795c for instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 on hv-cinder-82002 Aug 17 20:07:13.122956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-2b476651-3a1d-43bd-a835-733878d292c8 req-6a728c3e-253c-4b0e-b766-680640a323bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031966 Aug 17 20:07:13.122956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 229/467] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:13.281877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:13.282811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:13.290230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:13.290991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:13.291723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:13.292742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:13.293293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:13.293839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:13.435912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:13.443419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3f0366ba-8068-4734-af05-64faf589a9ed tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.166946 Aug 17 20:07:13.443995 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 239/468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:13 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:14.465069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:14.465819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:14.472204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:14.472669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:14.473101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:14.473834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:14.474267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:14.474684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:14.607994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:14.615373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b280fffc-474a-456b-8d7e-2370a785a0e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.155203 Aug 17 20:07:14.615935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 230/469] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:14 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:15.636659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:15.637293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:15.644174 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:15.644657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:15.645087 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:15.646029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:15.646484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:15.646867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:15.651855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:15.794422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:15.802479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b426b7ff-0fc7-4a31-875e-6d90b5c6fa5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.169998 Aug 17 20:07:15.803045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 240/470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:15 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:16.677951 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:16.678722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:16.689528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:16.690344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:16.691043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:16.692152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:16.692939 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:16.693481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:16.717214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ef12926f-1721-4a22-8a63-71a0a3f71c12 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/ips" status: 200 len: 146 microversion: 2.1 time: 0.046117 Aug 17 20:07:16.717803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 231/471] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:07:16 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:16.825472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:16.826237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:16.835001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:16.835603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:16.836167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:16.837009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:16.837579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:16.838133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:16.985381 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:16.995669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2d45e57a-fb79-4d37-877f-54ee1abf79a3 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.175542 Aug 17 20:07:16.996417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 241/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:16 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:18.020833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:18.021862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:18.029308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:18.029822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:18.030248 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:18.030927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:18.031374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:18.031792 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:18.175195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:18.186523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9cc44056-e636-41a0-b19a-30c0c8ca94cf tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.171910 Aug 17 20:07:18.187343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 232/473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:18 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:18.631317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2072702831", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "networks": [{"uuid": "4194b2e2-7faa-4753-a531-b2e77e07b207"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:18.687791 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] validate_networks() for [('4194b2e2-7faa-4753-a531-b2e77e07b207', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:07:19.053840 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:07:19.054349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:07:19.055088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:07:19.055514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:07:19.055964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:07:19.065495 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.066005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.066434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.067151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.067610 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.068024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.084991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Getting quotas for project efac6ddeea0d4d458b7de89c533e540d. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:07:19.089487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Getting quotas for user 1fa6eb4bc1e54b6a80b038ea768d902c and project efac6ddeea0d4d458b7de89c533e540d. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:07:19.101294 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:07:19.103561 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:07:19.149101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-726ed8d8-cfe2-465f-9685-381b7550cf11 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521713 Aug 17 20:07:19.149784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 242/474] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:07:19.160722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3889a481-6ae8-46ce-a81f-6456dc2bf0c9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:19.161303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3889a481-6ae8-46ce-a81f-6456dc2bf0c9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:19.210440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:19.211135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:19.220835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3889a481-6ae8-46ce-a81f-6456dc2bf0c9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:19.221815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.222430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.222954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.224634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.225181 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.225788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.227793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3889a481-6ae8-46ce-a81f-6456dc2bf0c9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1219 microversion: 2.1 time: 0.071025 Aug 17 20:07:19.228552 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 233/475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:19 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:07:19.357706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:19.365594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9cffe0e7-4b8f-4698-9ee2-aeee1d073576 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1366 microversion: 2.1 time: 0.159039 Aug 17 20:07:19.366173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 243/476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:19 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:07:19.762455 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1f0ba23-7cb5-404f-8410-38d08581b6bd"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:19.764753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:19.773939 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.774613 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.775074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.775934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:19.776533 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:19.777018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:19.781392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:20.240695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6085d331-662f-42c5-b1bf-12bbdc7c10ac tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481977 Aug 17 20:07:20.241396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 234/477] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:07:19 2022] POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:20.248462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:20.249145 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:20.256119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.256693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.257321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.258186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.258814 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.259252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.332208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:20.339949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c9b9b741-e3a6-4ebc-a5d0-ebee3bea96c8 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1215 microversion: 2.1 time: 0.095541 Aug 17 20:07:20.340695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 244/478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:20 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:20.388130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:20.388761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:20.395039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.395508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.395906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.396584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.397027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.397440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.528807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:20.540702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-74478c73-45dd-4482-850b-afaf7524acd7 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1556 microversion: 2.1 time: 0.156996 Aug 17 20:07:20.541440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 235/479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:20 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:20.561415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:20.561930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:20.568317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.568792 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.569217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.569942 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:20.570410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:20.570828 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:20.647807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-46dc7348-98c4-4290-a999-7cd805031519 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090230 Aug 17 20:07:20.648429 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 245/480] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:07:20 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:21.362014 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:21.363311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:21.370692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:21.371364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:21.371941 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:21.372789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:21.373411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:21.373997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:21.703349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:21.711263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b9d543b2-5081-4e73-b64e-8c589f874b99 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.353137 Aug 17 20:07:21.711825 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 236/481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:21 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:21.914803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958f5b11-f1b0-419c-9c9f-e7b3ee980ba6", "tag": "80f09e64-52f2-479d-82c3-f09657e6795c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:21.925377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:21.926210 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:21.926328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:21.938801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] Creating event network-changed:80f09e64-52f2-479d-82c3-f09657e6795c for instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 on hv-cinder-82002 Aug 17 20:07:21.944378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-d00956b6-7f23-428f-ab79-46c615fc7704 req-a05b972a-bfb3-4a1b-af82-ec0d237d7f59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033872 Aug 17 20:07:21.945191 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 246/482] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:22.237272 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e7e4e7-e2e2-420d-83fa-6d2a25705deb", "tag": "903f9652-fb5f-4362-98c7-dc20140fa0fa"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:22.251578 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:22.252052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:22.252816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:22.267420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] Creating event network-changed:903f9652-fb5f-4362-98c7-dc20140fa0fa for instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb on hv-cinder-82002 Aug 17 20:07:22.273324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-3bbe1223-f33e-4dbc-a933-099dd658aa09 req-41fcec9a-d25d-4d49-9035-b4a12812a127 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Aug 17 20:07:22.274342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 237/483] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:22.732843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:22.733500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:22.740228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:22.740804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:22.741297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:22.742081 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:22.742647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:22.743277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:22.889867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:22.897575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6173574d-5013-46a6-bfaf-fa1d2cc9d313 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.169118 Aug 17 20:07:22.898141 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 247/484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:22 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:23.923152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:23.924072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:23.927000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:23.934759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:23.935384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:23.935942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:23.936970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:23.937589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:23.938149 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:24.077269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:24.088547 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-467adf9c-d439-4cdc-a4fc-d43937cbef89 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.172613 Aug 17 20:07:24.089295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 238/485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:23 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:25.112991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:25.113993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:25.117740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:25.123602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:25.124073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:25.124498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:25.125181 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:25.125623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:25.126035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:25.263433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:25.275170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-df049c15-8bc4-48cf-9270-3e8b01d14d78 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.168752 Aug 17 20:07:25.275739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 248/486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:25 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:26.295779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:26.296387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:26.303688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:26.304167 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:26.304599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:26.305284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:26.305774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:26.306193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:26.439867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:26.448128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f591ede2-83e9-43d7-8eba-3bc70e91a8ea tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.156093 Aug 17 20:07:26.456263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 239/487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:26 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:27.473880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:27.474839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:27.486019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:27.486819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:27.487528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:27.488666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:27.489413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:27.490190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:27.648588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:27.656496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f64bfdd1-462c-449b-8c29-4e07f7f0034e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.189451 Aug 17 20:07:27.657038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 249/488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:27 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:28.680715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:28.681776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:28.688611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:28.689089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:28.689513 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:28.690227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:28.690670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:28.691083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:28.822564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:28.830308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8779616b-881c-4caf-97bd-383be5b6e060 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.156447 Aug 17 20:07:28.830891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 240/489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:28 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:28.876227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:28.882748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:28.883226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:28.883654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:28.945007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Going to try to stop instance {{(pid=120819) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 20:07:28.990830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-951487a2-0197-4a37-81ed-3ba7798d8262 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action" status: 202 len: 0 microversion: 2.1 time: 0.118345 Aug 17 20:07:28.991420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 250/490] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:07:28 2022] POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:07:28.999610 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:29.000220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:29.006198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:29.006717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:29.007096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:29.007807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:29.008251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:29.008672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:29.146542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:29.157270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-246fa6cb-86cf-48ee-ba6c-de7ade776fa3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.161036 Aug 17 20:07:29.157694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 241/491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:28 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:29.330829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:29.331578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:29.336144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e7e4e7-e2e2-420d-83fa-6d2a25705deb", "name": "network-vif-plugged", "status": "completed", "tag": "903f9652-fb5f-4362-98c7-dc20140fa0fa"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:29.348160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:29.348652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:29.349081 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:29.360394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] Creating event network-vif-plugged:903f9652-fb5f-4362-98c7-dc20140fa0fa for instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb on hv-cinder-82002 Aug 17 20:07:29.365208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-5d3c9570-d6a2-4b87-81be-a8ab13abd160 req-df6687e0-4eec-4d91-9ed4-ee84f50113cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035256 Aug 17 20:07:29.366383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 251/492] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:07:29.854942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:29.855769 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:29.857755 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:29.864124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:29.864575 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:29.865019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:29.865762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:29.866230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:29.866670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:29.998632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:30.006132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b6020ff3-5796-4eb4-aa16-b0c0ceb4ed3b tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.157170 Aug 17 20:07:30.006689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 242/493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:29 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:30.184922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:30.185640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:30.192708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:30.193187 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:30.193641 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:30.194329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:30.194770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:30.195186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:30.337588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:30.346255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-10f3b6e9-10fa-48f9-964a-c421d664b42c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.167558 Aug 17 20:07:30.346841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 252/494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:30 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:31.029057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:31.029688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:31.036913 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:31.037395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:31.037859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:31.038545 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:31.038993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:31.039397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:31.179333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:31.187081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2df04606-a17e-4ce0-b259-ec1c2274af45 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1319 microversion: 2.1 time: 0.163208 Aug 17 20:07:31.187648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 243/495] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:31 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:31.371870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:31.372829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:31.383761 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:31.384441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:31.385148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:31.386449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:31.386947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:31.387314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:31.523616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:31.536213 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-08b479b4-ed8e-499a-9e13-cdbdc88563d1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.170677 Aug 17 20:07:31.537028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 253/496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:31 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:32.207839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:32.208391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:32.215239 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.215715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.216136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.216813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.217238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.217685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.353308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:32.361063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6e26ebfa-cc65-4f40-b16f-34885a463a33 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1509 microversion: 2.1 time: 0.157091 Aug 17 20:07:32.361652 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 244/497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:32 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:32.381114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7afcfbd-169e-42cb-a0fa-61196bdbc8a4", "device": "/dev/sdb"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:32.383564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:32.390575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.391041 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.391464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.392148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.392588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.392994 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.559602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:32.560274 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:32.566932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.567327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.568012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.568433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:32.568879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:32.569299 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:32.685647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-59550e49-1c6d-4b25-9da6-fbd77170d38e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "POST /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308221 Aug 17 20:07:32.686235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 254/498] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:07:32 2022] POST /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:07:32.708339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:32.716668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7bad55a7-350a-400c-a39e-61b93ebdb9e9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.161222 Aug 17 20:07:32.717240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 245/499] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:32 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:33.742963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:33.744102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:33.754797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:33.755617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:33.756285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:33.757406 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:33.758188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:33.758875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:33.899314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:33.909004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f9a05a36-1517-4c57-a34a-b2e620267fb6 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.173961 Aug 17 20:07:33.909662 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 255/500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:33 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:34.942154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:34.943150 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:34.954864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:34.955645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:34.956358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:34.957718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:34.958462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:34.959159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:35.105686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:35.113807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-25ca4d09-ddd9-41ab-81de-0068f763a3a0 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.177993 Aug 17 20:07:35.114381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 246/501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:34 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:36.135293 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:36.135873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:36.143424 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:36.143950 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:36.144421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:36.145175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:36.145696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:36.146167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:36.290279 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:36.295167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:36.302510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2f1e316d-21e0-4e39-8829-a9cd40bd70d9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.171345 Aug 17 20:07:36.303273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 256/502] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:36 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:37.327812 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:37.328791 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:37.339825 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:37.340663 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:37.341387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:37.342670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:37.343413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:37.344106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:37.492088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:37.504685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1c56b0eb-5b28-4b1f-a56d-28545f357408 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.183289 Aug 17 20:07:37.505472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 247/503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:37 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:38.531195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:38.531863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:38.540960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:38.541520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:38.542048 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:38.542858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:38.543373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:38.543868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:38.681782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:38.690339 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-81e55339-2b90-4fd2-9012-74476f9b20ef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.163980 Aug 17 20:07:38.690915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 257/504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:38 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:39.718353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:39.719362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:39.730465 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:39.731290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:39.732124 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:39.732986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:39.733456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:39.733896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:39.886187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:39.898731 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-11d6c411-56a0-432c-8762-206100a14d93 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.187355 Aug 17 20:07:39.899475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 248/505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:39 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:40.922898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:40.923717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:40.931975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:40.932710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:40.933212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:40.934222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:40.934732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:40.935274 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:41.081348 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:41.094666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91772559-336f-441e-bf40-23cf1244a8a1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.176010 Aug 17 20:07:41.095582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 258/506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:40 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:42.124246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:42.124928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:42.132960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:42.133523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:42.134063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:42.134879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:42.135397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:42.135901 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:42.279971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:42.292522 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3e9c187f-e0ab-4f09-8bb5-5027d48e80b3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.174038 Aug 17 20:07:42.293388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 249/507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:42 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:43.324948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:43.325979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:43.334501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:43.335006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:43.335461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:43.336185 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:43.336658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:43.337137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:43.477340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:43.485730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-51ac8ce8-895b-4d67-9d14-157a64d47e6d tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.167312 Aug 17 20:07:43.486298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 259/508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:43 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:44.505730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:44.506421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:44.513189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:44.513805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:44.514310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:44.515069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:44.515577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:44.515993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:44.520034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:44.652020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:44.660648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b03f38c0-2cfc-43f5-9353-3868c1b9169e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.158757 Aug 17 20:07:44.661220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 250/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:44 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:45.683266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:45.683931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:45.693489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:45.694257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:45.694919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:45.696046 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:45.696843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:45.697426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:46.002006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:46.010442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-899fe064-f6cc-4afa-ac4b-cc748c9fff77 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.331755 Aug 17 20:07:46.011001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 260/510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:45 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:47.042710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:47.043555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:47.052029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:47.052507 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:47.052938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:47.053668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:47.054170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:47.054587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:47.246959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:47.257465 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a15d989d-bd1e-4a82-bb93-c91fb7d13207 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.221434 Aug 17 20:07:47.258341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 251/511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:47 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:48.282354 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:48.283045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:48.290899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:48.291415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:48.291896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:48.292638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:48.293163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:48.293659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:48.440628 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:48.449311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e9e78f84-7a29-445d-9a5c-03ad92c36dc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.173090 Aug 17 20:07:48.449924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 261/512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:48 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:49.476957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:49.478244 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:49.489403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:49.490399 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:49.491114 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:49.492241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:49.492984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:49.493694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:49.633185 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:49.645323 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2aed900d-a2f0-4e3f-aad2-2ceb2bbb7495 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.177365 Aug 17 20:07:49.646123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 252/513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:49 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:50.671148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:50.672162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:50.680534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:50.681008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:50.681431 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:50.682140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:50.682585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:50.682982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:50.812897 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:50.821158 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b166ae49-9c96-4656-bf10-5651e6ccd44c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1724 microversion: 2.1 time: 0.156729 Aug 17 20:07:50.821862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 262/514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:50 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:51.846757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:51.847753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:51.855464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:51.855948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:51.856367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:51.857051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:51.857496 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:51.857944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:51.998626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:52.006932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c4228403-b47f-4d05-8d9c-d709a12dd816 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1701 microversion: 2.1 time: 0.166774 Aug 17 20:07:52.007504 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 253/515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:51 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:52.030052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:07:52.040021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:52.040720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:52.041309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:52.067559 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Going to try to start instance {{(pid=120819) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 20:07:52.117755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-35434793-e1ae-4033-968e-90109b4a571a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action" status: 202 len: 0 microversion: 2.1 time: 0.093690 Aug 17 20:07:52.118360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 263/516] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:07:52 2022] POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:07:52.126923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:52.127609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:52.134153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:52.134445 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:52.134904 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:52.135671 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:52.136092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:52.136697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:52.266909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:52.275205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b07ed2bb-598d-4203-b38e-1e66f96e894b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1710 microversion: 2.1 time: 0.152356 Aug 17 20:07:52.276022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 254/517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:52 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:07:53.298582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:53.299183 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:53.305713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:53.306189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:53.306612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:53.307294 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:53.307740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:53.308153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:53.447073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:53.455459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9024614d-2bb5-4c38-b152-b220c76b4fef tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1710 microversion: 2.1 time: 0.161673 Aug 17 20:07:53.456038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 264/518] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:53 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:54.478085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:54.479691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:54.482632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=34 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:54.488577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:54.489089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:54.489680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:54.490471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:54.490947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:54.491446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:54.624697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:54.633076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-09054b74-1822-46f1-a6ef-c0b4fd05fdc7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1714 microversion: 2.1 time: 0.159824 Aug 17 20:07:54.633641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 255/519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:54 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:07:56.347505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:56.348082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:56.350569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=34 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:07:56.356194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:56.356780 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:56.357206 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:56.357892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:56.358352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:56.358762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:56.488300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lazy-loading 'services' on Instance uuid 44e7e4e7-e2e2-420d-83fa-6d2a25705deb {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:07:56.615196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-470d925a-3a3f-4b60-b49d-6e372995295d tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb/os-volume_attachments/a7afcfbd-169e-42cb-a0fa-61196bdbc8a4" status: 202 len: 0 microversion: 2.1 time: 0.271381 Aug 17 20:07:56.615943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 265/520] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:07:56 2022] DELETE /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb/os-volume_attachments/a7afcfbd-169e-42cb-a0fa-61196bdbc8a4 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:07:58.805319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:58.805879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:58.812461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:58.812937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:58.813366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:58.814085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:58.814529 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:58.814942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:58.842762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:07:58.931766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-60c11351-d681-41c7-953a-88ab5426fe42 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 204 len: 0 microversion: 2.1 time: 0.130001 Aug 17 20:07:58.932401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 256/521] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:07:58 2022] DELETE /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:07:58.943162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:07:58.944265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:07:58.951186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:58.951765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:58.952209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:58.952965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:07:58.953444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:07:58.953892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:07:59.086237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:07:59.094035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-82919168-cc2f-4606-bea7-0aa03718ec5e tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1515 microversion: 2.1 time: 0.156796 Aug 17 20:07:59.094538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 266/522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:07:58 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:00.122680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:00.123378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:00.130326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:00.130809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:00.131277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:00.131975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:00.132426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:00.132849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:00.275680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:00.283592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3d8848d0-356f-4f23-b8ff-ab3f97873f87 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1515 microversion: 2.1 time: 0.166682 Aug 17 20:08:00.284155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 257/523] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:00 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:01.305208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:01.305819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:01.312772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:01.313252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:01.313706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:01.314388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:01.314829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:01.315242 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:01.457600 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:01.469285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-24ddeae1-a3cc-42fb-b19a-f152b3bf25b9 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1515 microversion: 2.1 time: 0.167785 Aug 17 20:08:01.470091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 267/524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:01 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:02.494017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:02.494648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:02.502105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:02.502589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:02.503019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:02.503750 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:02.504196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:02.504617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:02.647260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa6eb4bc1e54b6a80b038ea768d902c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efac6ddeea0d4d458b7de89c533e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:02.655724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0d9a064f-6c9f-423e-99ad-18857c0b0f20 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 200 len: 1515 microversion: 2.1 time: 0.165659 Aug 17 20:08:02.656290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 258/525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:02 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:02.974022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e7e4e7-e2e2-420d-83fa-6d2a25705deb", "name": "network-vif-deleted", "tag": "903f9652-fb5f-4362-98c7-dc20140fa0fa"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:08:02.984870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:02.985329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:02.985790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:02.997322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] Creating event network-vif-deleted:903f9652-fb5f-4362-98c7-dc20140fa0fa for instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb on hv-cinder-82002 Aug 17 20:08:03.002356 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-662d7f62-c5e8-4809-8958-a2af6a000e63 req-05416d53-59aa-4fc4-91bb-862fa2f4809a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Aug 17 20:08:03.002964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 268/526] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:08:03.680936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:03.681966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] [instance: 44e7e4e7-e2e2-420d-83fa-6d2a25705deb] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:03.693019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:03.693920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:03.694689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:03.695824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:03.696572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:03.697264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:03.711352 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] HTTP exception thrown: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Request method failure captured: Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb HTTP/1.1 Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Un6Qjw_3MHSXB1Dzc7SQrSIxGwnV-yu4jmZwMQ_ZLdaSoE-ZJZGQ6a080Ku4XmDiupqGaXK1SNyLkCzys2Mi7jzD3InlF7xfYezpuPf_nTpR4wrN_bSN2WNaEcWgmeBJQm-soMa9WwshDa8ljU2JwHdvbACM22M_FwFtQEznGou2pw Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: efac6ddeea0d4d458b7de89c533e540d Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:08:03.712984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efac6ddeea0d4d458b7de89c533e540d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: efac6ddeea0d4d458b7de89c533e540d Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-86842674 Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotTestJSON-86842674-project Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 1fa6eb4bc1e54b6a80b038ea768d902c Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotTestJSON-86842674-project Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. Aug 17 20:08:03.714728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '44e7e4e7-e2e2-420d-83fa-6d2a25705deb'} Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:08:03.715625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. Aug 17 20:08:03.717012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:08:03.718283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] Returning 404 to user: Instance 44e7e4e7-e2e2-420d-83fa-6d2a25705deb could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:08:03.718283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ea92f799-58ce-46d5-ae83-9e5319214038 tempest-VolumesSnapshotTestJSON-86842674 tempest-VolumesSnapshotTestJSON-86842674-project] 10.222.0.18 "GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb" status: 404 len: 111 microversion: 2.1 time: 0.040517 Aug 17 20:08:03.718283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 259/527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:03 2022] GET /compute/v2.1/servers/44e7e4e7-e2e2-420d-83fa-6d2a25705deb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:08:27.195157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=7 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:27.195914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:27.310133 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec74b424-0b36-4f8b-b9bc-af0d762c1989"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:08:27.312654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:27.318962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:27.319433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:27.319859 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:27.320612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:27.321057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:27.321471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:27.626580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-27274d57-fdc4-404a-81d9-8fe3ef59f3ab tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432366 Aug 17 20:08:27.627363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 269/528] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:08:27 2022] POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:08:35.207125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:08:35.209421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:35.211668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:35.212321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:35.218110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:35.218591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:35.219024 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:35.219706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:35.220155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:35.220566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:35.245616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lazy-loading 'flavor' on Instance uuid 5bc35c2c-0cce-43cb-b988-9920dfada09e {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:08:35.385381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-32e4d83f-3dca-4e42-bc74-422abbb5eebf tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/action" status: 200 len: 32 microversion: 2.1 time: 0.182006 Aug 17 20:08:35.385922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 260/529] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:08:35 2022] POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:08:35.396850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:35.397560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:35.405770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:35.405886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:35.406356 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:35.407297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:35.407923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:35.408560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:35.544634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:35.553224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3c1ca4ea-85e4-4188-b806-b90f7cea6383 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.161164 Aug 17 20:08:35.553819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 270/530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:35 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:36.575241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:36.575941 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:36.582377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:36.582854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:36.583288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:36.583974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:36.584419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:36.584866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:36.717918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:36.726530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-da56cd86-6255-4e2c-b5dd-53e806df88f1 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.156423 Aug 17 20:08:36.727101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 261/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:36 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:37.751778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:37.752766 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:37.766554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:37.767341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:37.768054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:37.769182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:37.769966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:37.770666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:37.912235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:37.921815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b21ceef4-b296-49c9-a095-4071b8f95998 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.176464 Aug 17 20:08:37.922387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 271/532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:37 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:38.947224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:38.947865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:38.954472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:38.954947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:38.955373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:38.956053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:38.956498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:38.956912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:39.094846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:39.103139 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3444e6e-fda8-4399-85da-211bb3a09d05 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.159835 Aug 17 20:08:39.103821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 262/533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:38 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:40.136478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:40.137333 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:40.148375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:40.149178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:40.149962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:40.150982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:40.151427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:40.151845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:40.286631 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:40.298762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-446adcf4-7371-45d0-930d-34434bb235c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.168741 Aug 17 20:08:40.299535 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 272/534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:40 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:41.325478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:41.326075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:41.333424 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:41.333942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:41.334371 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:41.335071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:41.335516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:41.335905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:41.479102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:41.487343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a62f7c4e-6ed2-4398-9f5e-90bf3181c628 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.166675 Aug 17 20:08:41.487872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 263/535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:41 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:42.512505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:42.513396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:42.524182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:42.524965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:42.525770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:42.526455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:42.526908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:42.527310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:42.656814 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:42.665568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a36ff996-3415-49fd-b28c-7f31219b07a5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.159686 Aug 17 20:08:42.666255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 273/536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:42 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:43.691399 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:43.693042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:43.703197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:43.703692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:43.704132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:43.704845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:43.705291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:43.705748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:43.848171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:43.861161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6b3408da-a0e4-4c15-abb3-ba005bb34b45 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.176517 Aug 17 20:08:43.861984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 264/537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:43 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:44.886688 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:44.887699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:44.898625 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:44.899412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:44.900128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:44.901264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:44.902051 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:44.902739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:45.045033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:45.053423 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ffd253e7-57e4-475b-b932-a09d3d220fea tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.173436 Aug 17 20:08:45.054058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 274/538] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:44 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:46.080112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:46.081092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:46.091506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:46.092457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:46.093030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:46.093789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:46.094283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:46.094735 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:46.228350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:46.240623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6e271271-e88c-45ae-8e3f-1695b80446de tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.168010 Aug 17 20:08:46.241390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 265/539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:46 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:47.265416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:47.266032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:47.273606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:47.274315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:47.274896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:47.275943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:47.276568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:47.277137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:47.421956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:47.430813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-31a492f6-929e-40e4-8ca6-ca0fb10a2632 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.170983 Aug 17 20:08:47.431389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 275/540] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:47 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:48.456751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:48.457879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:48.468228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:48.468703 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:48.469129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:48.469846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:48.470292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:48.470705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:48.604293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:48.614472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0d76e1e1-c679-4a33-a17d-cc9f394e29c5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.164167 Aug 17 20:08:48.615041 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 266/541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:48 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:49.639861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:49.640880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:49.651983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:49.652800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:49.653583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:49.654693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:49.655143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:49.655557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:49.797148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:49.809944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2e556bdf-cb90-43e8-9e9a-4fb175f525a4 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.176363 Aug 17 20:08:49.810820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 276/542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:49 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:50.835960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:50.836824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:50.847649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:50.848430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:50.849138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:50.850427 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:50.851177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:50.851865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:50.983457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:50.991608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c02816ee-ea00-4080-845f-abc49e1e9dba tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.162323 Aug 17 20:08:50.992170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:50 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:52.016161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:52.016979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:52.029386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:52.030196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:52.030946 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:52.031680 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:52.032177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:52.032592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:52.179353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:52.187635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-610dca62-48d2-4c38-a13c-e04e3854a4ae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.178126 Aug 17 20:08:52.188212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 277/544] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:52 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:53.213232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:53.214397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:53.224931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:53.225766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:53.226487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:53.227608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:53.228341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:53.229028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:53.367013 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:53.377155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d6d8c427-56e2-433e-8856-aa3bae407418 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.170488 Aug 17 20:08:53.377759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 268/545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:53 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:54.402914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:54.403847 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:54.411707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:54.412208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:54.412652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:54.413372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:54.413869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:54.414300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:54.552958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:54.561099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-888aa19e-d0f6-4b7f-9dc5-91a79bd29b91 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1735 microversion: 2.1 time: 0.165140 Aug 17 20:08:54.561811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 278/546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:54 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:55.582651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:55.583294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:55.590448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.590918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.591344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:55.592019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.592459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.592866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:55.736982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:55.745412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-46ba7ade-0d61-4806-8bfd-1db4fd7cad86 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1715 microversion: 2.1 time: 0.166576 Aug 17 20:08:55.745995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 269/547] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:55 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:55.853969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:55.854471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:55.861113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.861629 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.862060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:55.862745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.863190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.863602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:55.949188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] HTTP exception thrown: Cannot 'detach_volume' instance 5bc35c2c-0cce-43cb-b988-9920dfada09e while it is in vm_state rescued Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Request method failure captured: Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments/ec74b424-0b36-4f8b-b9bc-af0d762c1989 HTTP/1.1 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul1u0HN3oVR4RMY3Y3Cwi5A2gROomyi7Pi_hTbKDQYA_MRp7kiAx32AFB0ALGZyKk9lKXdsUowEfi26IaD7JWg1eUDRx3aOoyYhtWh--oqyrggBCO3BS1JOqkKY77Dw32XdudJqQtKW20QIbdjd63bWT9_vqQC6URXDSCDvKzbsFY4 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: db932807b4634440ba61a82446e82874 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:08:55.951453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/db932807b4634440ba61a82446e82874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_db932807b4634440ba61a82446e82874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: db932807b4634440ba61a82446e82874 Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: a5aece8a7f2342cfabd9a3f8707a4470 Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:08:55.953077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Cannot 'detach_volume' instance 5bc35c2c-0cce-43cb-b988-9920dfada09e while it is in vm_state rescued Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'server_id': '5bc35c2c-0cce-43cb-b988-9920dfada09e', 'id': 'ec74b424-0b36-4f8b-b9bc-af0d762c1989'} Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:08:55.954084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5bc35c2c-0cce-43cb-b988-9920dfada09e while it is in vm_state rescued Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5bc35c2c-0cce-43cb-b988-9920dfada09e while it is in vm_state rescued Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:08:55.955543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Returning 409 to user: Cannot 'detach_volume' instance 5bc35c2c-0cce-43cb-b988-9920dfada09e while it is in vm_state rescued {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:08:55.956763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-790eb4d1-ad24-4ad6-838e-3876ef675689 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments/ec74b424-0b36-4f8b-b9bc-af0d762c1989" status: 409 len: 152 microversion: 2.1 time: 0.102834 Aug 17 20:08:55.956763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 279/548] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:08:55 2022] DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments/ec74b424-0b36-4f8b-b9bc-af0d762c1989 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 20:08:55.961892 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:08:55.962425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:55.968743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.969220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.969683 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:55.970371 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:55.970826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:55.971232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:56.040537 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-20cbc0d9-25fd-42dc-b654-0143bcf34f7a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/action" status: 202 len: 0 microversion: 2.1 time: 0.082329 Aug 17 20:08:56.044219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 270/549] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:08:55 2022] POST /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:08:56.049732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:56.050748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:56.059496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:56.061094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:56.061919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:56.062990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:56.063540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:56.064315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:56.195303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:56.203580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-06d9d478-4fd5-4032-ab9b-a9ba6033682d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1723 microversion: 2.1 time: 0.157822 Aug 17 20:08:56.204163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 280/550] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:56 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:57.230783 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:57.231964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:57.242679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:57.243465 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:57.244177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:57.245312 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:57.246086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:57.246790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:57.386055 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:57.394689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-03214601-376b-4545-a1d6-12e4c11d0640 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1723 microversion: 2.1 time: 0.172037 Aug 17 20:08:57.395292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 271/551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:57 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:58.420323 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:58.421476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:58.423878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=25 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:58.429792 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:58.430295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:58.430722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:58.431427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:58.431869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:58.432284 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:58.435018 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:08:58.564887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:58.573107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bae8b1e4-b895-43b0-bb6e-f592403c313a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1723 microversion: 2.1 time: 0.159496 Aug 17 20:08:58.573738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 281/552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:58 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:08:59.594885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:08:59.595493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:08:59.602447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:59.602926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:59.603358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:59.604043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:08:59.604488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:08:59.604912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:08:59.741896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:08:59.752392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-edc2325b-051c-499d-a27d-b43aae9d5d06 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1723 microversion: 2.1 time: 0.161872 Aug 17 20:08:59.752957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 272/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:08:59 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:00.780758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:00.781760 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:00.792891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:00.793729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:00.794448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:00.795580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:00.796476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:00.796908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:00.926194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:00.934472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-971c4728-da75-4db1-8b56-b2a7a25dbf7d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1729 microversion: 2.1 time: 0.160693 Aug 17 20:09:00.935045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 282/554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:00 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:00.955305 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:00.955851 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:00.962535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:00.963010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:00.963432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:00.964106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:00.964541 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:00.964971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:00.981681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:01.044485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ad3bd93-d631-48a4-b021-97cf126befae tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092850 Aug 17 20:09:01.045395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 273/555] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:09:00 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:02.299120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:02.308889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:02.309350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:02.309788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:02.321204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] Creating event network-changed:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:09:02.326860 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-1040350a-b1f0-4bff-b1d9-e2775558449b req-e2ef7448-70e1-4663-8d0d-af53a04c5ad5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160945 Aug 17 20:09:02.327576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 283/556] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:02.608574 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:02.609138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:02.615143 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:02.615617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:02.616038 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:02.616718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:02.617162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:02.617580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:02.701022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lazy-loading 'services' on Instance uuid 32fcce73-27be-4ef7-a694-4e85c4d9ca67 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:09:02.782419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1a86bc8e-2ee4-440e-b581-b509ecc3e812 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments/f1f0ba23-7cb5-404f-8410-38d08581b6bd" status: 202 len: 0 microversion: 2.1 time: 0.290573 Aug 17 20:09:02.788109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 274/557] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:09:02 2022] DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments/f1f0ba23-7cb5-404f-8410-38d08581b6bd => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:03.922593 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:03.929196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:03.929699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:03.930157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:03.952462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Going to try to stop instance {{(pid=120819) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 20:09:04.001379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0a84d6c0-8cc3-436c-8d0d-e89f93f792b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action" status: 202 len: 0 microversion: 2.1 time: 0.083625 Aug 17 20:09:04.002121 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 284/558] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:09:03 2022] POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:04.011498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:04.012290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:04.019003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:04.019490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:04.019905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:04.020607 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:04.021031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:04.021444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:04.158604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:04.166742 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eb822a13-7393-48b8-ad65-da532c8fe4e3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.159937 Aug 17 20:09:04.167334 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 275/559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:04 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:04.348123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:04.362416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:04.362877 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:04.363298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:04.376173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] Creating event network-changed:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:09:04.381019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-1f3aac1e-9c54-4770-ba9b-ffb82885adde req-2f9c6dff-b7dc-438b-a2f0-04579077bb97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039839 Aug 17 20:09:04.381751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 285/560] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:05.192344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:05.193760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:05.204043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:05.204528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:05.204960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:05.205686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:05.206113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:05.206561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:05.342550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:05.350839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3964b679-1636-41e2-8714-f25c71dd62b5 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.165086 Aug 17 20:09:05.351407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 276/561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:05 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:06.376777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:06.377639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:06.386476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:06.387072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:06.387605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:06.388448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:06.389016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:06.389563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:06.529813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:06.541980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a512a30c-64f0-412a-bd52-6a0ac2c9abcd tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.171702 Aug 17 20:09:06.542687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 286/562] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:06 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:07.282806 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:07.283340 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:07.285273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=35 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:07.290628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.291092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.291517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.292438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.292875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.293282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.316654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fde6f545-a936-4de4-8dcc-5af1cc14412f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/ips" status: 200 len: 149 microversion: 2.1 time: 0.147059 Aug 17 20:09:07.317188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 277/563] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:09:07 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/ips => generated 149 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:07.329209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1e91ae-26df-4fde-adf4-81074c7d9db8"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:07.331602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:07.337753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.338235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.338660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.339349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.339790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.340201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.422364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: POST /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/os-volume_attachments HTTP/1.1 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 74 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:09:07.424143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {"volumeAttachment": {"volumeId": "fd1e91ae-26df-4fde-adf4-81074c7d9db8"}} Aug 17 20:09:07.426020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'server_id': '958f5b11-f1b0-419c-9c9f-e7b3ee980ba6', 'body': {'volumeAttachment': {'volumeId': 'fd1e91ae-26df-4fde-adf4-81074c7d9db8'}}} Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:07.426807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:07.428288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 400 to user: Invalid volume: volume fd1e91ae-26df-4fde-adf4-81074c7d9db8 is already attached to instances: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9313f8dc-2ed7-450c-9a4b-29dea1fa30e4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100678 Aug 17 20:09:07.429855 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 287/564] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:09:07 2022] POST /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:09:07.434960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:07.435447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:07.441774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.442217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.442649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.443362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.443808 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.444236 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.468745 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:09:07.552628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f39e576-779e-4f4d-831d-883ea657936b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 204 len: 0 microversion: 2.1 time: 0.121189 Aug 17 20:09:07.553216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 278/565] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:09:07 2022] DELETE /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:09:07.562259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:07.562914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:07.564758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:07.565472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:07.571587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.572072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.572511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.573203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.573686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.574106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.574713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.575206 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.575642 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.576357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:07.576796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:07.577217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:07.763727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:07.767996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:07.771463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ba8cac38-b21e-4b03-89cd-70ea80870c57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.210820 Aug 17 20:09:07.772107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 279/566] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:07 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:07.775777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-31b12201-9230-4e3c-9d59-65f7432d7b9f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1680 microversion: 2.1 time: 0.217369 Aug 17 20:09:07.776337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 288/567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:07 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:08.797285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:08.798581 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:08.801107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:08.801778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:08.805795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:08.806278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:08.806710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:08.807397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:08.807862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:08.808291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:08.808393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:08.808869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:08.809283 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:08.810001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:08.810440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:08.810846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:09.003176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:09.007167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:09.010924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-54338976-4adc-472b-8b59-f0d8686102fc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.220034 Aug 17 20:09:09.011502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 280/568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:08 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:09.015013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-148ae2d3-a75d-4bce-a71a-14fedd220dcb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1680 microversion: 2.1 time: 0.219447 Aug 17 20:09:09.015578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 289/569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:08 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:10.031825 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:10.032419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:10.036378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:10.037008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:10.038925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:10.039400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:10.039829 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:10.040523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:10.040969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:10.041383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:10.044227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:10.044725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:10.045969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:10.046685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:10.047287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:10.047954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:10.131607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:10.140066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c7d91f02-7f20-4309-b074-0a9ea6fe4a4b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1612 microversion: 2.1 time: 0.107990 Aug 17 20:09:10.141232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 290/570] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:10 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:10.209468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:10.217651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9fcc316e-fc6e-4ce0-9e48-f195e26edd20 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.190025 Aug 17 20:09:10.218458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 281/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:10 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:09:10.692832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958f5b11-f1b0-419c-9c9f-e7b3ee980ba6", "name": "network-vif-deleted", "tag": "80f09e64-52f2-479d-82c3-f09657e6795c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:10.702789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:10.703325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:10.703689 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:10.714963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] Creating event network-vif-deleted:80f09e64-52f2-479d-82c3-f09657e6795c for instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 on hv-cinder-82002 Aug 17 20:09:10.719592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-426625b8-2c02-4014-92ba-259dbb8598e6 req-b1f42fc8-0350-474f-b502-d554ede3e4c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091857 Aug 17 20:09:10.723162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 291/572] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:11.170531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:11.171778 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:11.187036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:11.187819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:11.188241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:11.188993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:11.189444 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:11.190018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:11.239601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:11.240937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:11.254182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:11.254989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:11.255586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:11.256471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:11.257179 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:11.259375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:11.267740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:11.274632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:11.275491 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:11.276012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'fault' on Instance uuid 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:09:11.343518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:11.358289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b33088b-6247-4aa3-bd2a-22789967bbfa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 200 len: 1330 microversion: 2.1 time: 0.199797 Aug 17 20:09:11.358975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 282/573] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:11 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 1330 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:09:11.466618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:11.474785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-150fecdf-77d3-4cd1-870b-846d6c09c9d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.239348 Aug 17 20:09:11.475669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 292/574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:11 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:12.379774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:12.380319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:12.387294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:12.387767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:12.388191 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:12.388876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:12.389307 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:12.389758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:12.403682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 HTTP/1.1 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:09:12.405303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:09:12.406926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '958f5b11-f1b0-419c-9c9f-e7b3ee980ba6'} Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:09:12.407898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:09:12.409094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:09:12.410270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:09:12.410270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3e36f83e-fbbf-4399-aaf1-1c9a8aa6fdce tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 404 len: 111 microversion: 2.1 time: 0.031094 Aug 17 20:09:12.410270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 283/575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:12 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:09:12.415812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7fbfc175-5ccc-4217-98b4-3819b636668a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '.version_select at 0x7faaad3524c0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:12.455944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7fbfc175-5ccc-4217-98b4-3819b636668a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210012068" status: 202 len: 0 microversion: 2.1 time: 0.044096 Aug 17 20:09:12.456537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 293/576] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 17 20:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210012068 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:12.496076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:12.496881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:12.503590 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:12.504087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:12.504521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:12.505219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:12.505753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:12.506171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:12.663356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:12.671201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ab23e2f8-1263-46f6-bd70-a2677357026f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.179029 Aug 17 20:09:12.671771 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 284/577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:12 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:13.166095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:13.166579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:13.172534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.172997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.173459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.174152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.174592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.175000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.265030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'services' on Instance uuid 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:09:13.349558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-49732dbe-d7d8-4b0d-bfaf-f84f0f4181c1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments/fd1e91ae-26df-4fde-adf4-81074c7d9db8" status: 202 len: 0 microversion: 2.1 time: 0.187317 Aug 17 20:09:13.350173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 294/578] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:09:13 2022] DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments/fd1e91ae-26df-4fde-adf4-81074c7d9db8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:13.358892 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:13.361273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:13.367506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.368017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.368488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.369187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.369688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.370107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.403052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-db3fd537-645e-419b-bdec-405e3b0d41e8 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Aug 17 20:09:13.403981 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 285/579] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:09:13 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:13.696125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:13.697728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:13.704960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.705437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.705930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.706619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:13.707065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:13.707488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:13.849415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:13.860584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9137fcc9-34b1-4bd0-824b-86fb65e58f2c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.170896 Aug 17 20:09:13.861368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 295/580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:13 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:14.415774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:14.417984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:14.424555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.425026 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.425447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.426482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.426922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.427332 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.459540 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b1f38cea-7c64-40ca-ac6b-6560d6610f53 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047681 Aug 17 20:09:14.460102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 286/581] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:09:14 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:09:14.521735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:14.522225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:14.528255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.528728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.529152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.529867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.530311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.530724 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.555485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:09:14.640359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-890657ec-1945-402e-926b-0bd00d159295 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 204 len: 0 microversion: 2.1 time: 0.122216 Aug 17 20:09:14.640938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 296/582] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:09:14 2022] DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:09:14.649320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:14.649946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:14.656261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.656738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.657163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.657949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.658397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.658807 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.792184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:14.799889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-84939ca3-a9d8-4d94-b1af-09eeaebf8dfd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1682 microversion: 2.1 time: 0.154483 Aug 17 20:09:14.800494 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 287/583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:14 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:14.892560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:14.893715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:14.900574 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.901051 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.901707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.902393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:14.902837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:14.903252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:14.918508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:15.038727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:15.050114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-17c23d2d-4381-45e0-b147-f96119541482 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.164873 Aug 17 20:09:15.051237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 297/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:14 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:15.821974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:15.822577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:15.829326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:15.829859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:15.830287 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:15.830969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:15.831460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:15.831862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:15.959632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:15.963244 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:15.967802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad648f95-c0ba-4d23-9908-4053d3ec82e5 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1682 microversion: 2.1 time: 0.149707 Aug 17 20:09:15.968404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 288/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:15 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:16.072478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:16.073078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:16.079883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:16.080320 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:16.080725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:16.081422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:16.081915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:16.082327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:16.216884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:16.228723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-121bc7bb-5e36-41d9-ad1b-8ca405db4c01 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.160564 Aug 17 20:09:16.229552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 298/586] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:16 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:16.555795 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0cf12b-6cf9-4949-aca9-f97c710bdc8e", "name": "network-vif-deleted", "tag": "ad2b2082-63bd-4a99-bd2c-a95724875ff2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:16.568524 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:16.569302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:16.569984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:16.583906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] Creating event network-vif-deleted:ad2b2082-63bd-4a99-bd2c-a95724875ff2 for instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e on hv-cinder-82002 Aug 17 20:09:16.590970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a2f9e6b8-0da4-428a-ad8a-2865b94874fe req-f34df33e-ca25-4bbb-9365-e5962be91c6a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038714 Aug 17 20:09:16.592298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 289/587] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:16.988752 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:16.989347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:16.995686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:16.996158 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:16.996632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:16.997325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:16.997808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:16.998225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:17.031449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:17.031925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:17.032351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:17.032808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'fault' on Instance uuid 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:09:17.074340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:17.082494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d307033d-6829-4f45-8537-194d2691693b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 200 len: 1332 microversion: 2.1 time: 0.097704 Aug 17 20:09:17.083061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 299/588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:16 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:17.252932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:17.253784 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:17.260210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:17.260683 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:17.261110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:17.261824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:17.262268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:17.262682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:17.398254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:17.405857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ed87085c-6f1e-4c20-9a14-84a90f8b77b8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.158492 Aug 17 20:09:17.406431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 290/589] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:17 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:18.108074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:18.109066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:18.120101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:18.120852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:18.121614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:18.122784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:18.123529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:18.124223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:18.139658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e HTTP/1.1 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:09:18.141315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:09:18.142734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '3b0cf12b-6cf9-4949-aca9-f97c710bdc8e'} Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:09:18.143472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:09:18.144653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:09:18.145743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:09:18.145743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3cae2de5-6565-4e0c-bc86-5d3d012171e0 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 404 len: 111 microversion: 2.1 time: 0.042851 Aug 17 20:09:18.145743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 300/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:18 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:09:18.153528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5b1d9907-d370-4ea9-9917-de962c260b47 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '.version_select at 0x7faaacc28e50>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:18.157993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b1d9907-d370-4ea9-9917-de962c260b47 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:09:18.431834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:18.432694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:18.442832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:18.443624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:18.444341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:18.445470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:18.446260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:18.446960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:18.601240 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:18.609469 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-addbbe9e-6f66-4591-86f2-9a2d04f86317 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.184799 Aug 17 20:09:18.610076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 301/591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:18 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:19.170161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b1d9907-d370-4ea9-9917-de962c260b47 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44528. Aug 17 20:09:19.196665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5b1d9907-d370-4ea9-9917-de962c260b47 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058514039" status: 202 len: 0 microversion: 2.1 time: 1.046726 Aug 17 20:09:19.197437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 291/592] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 17 20:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058514039 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:19.638015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:19.638601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:19.645582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:19.646103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:19.646534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:19.647236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:19.647684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:19.648099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:19.884993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:19.895385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ee1d3c98-d5a2-46b8-94a6-d8ef8a03964f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.261291 Aug 17 20:09:19.896151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 302/593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:19 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:19.930564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75c695db-8c72-48aa-950e-c4c5c4f0aa79 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: .version_select at 0x7faaacb57670>, body: {"keypair": {"name": "tempest-keypair-1233152123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNanlslYnUiiolMQi4UOkvcIeo/dCtJUefF+rMBro2axwRxuSXKJVXKRnZuhkSvJe/4TAOTsVjOzdhIVEKs6atNlbEpDOL5X0LprgnqMdZsP1FL/c4yx52y4gZtxvGSAQ=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:19.950089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-75c695db-8c72-48aa-950e-c4c5c4f0aa79 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:09:19.954176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-75c695db-8c72-48aa-950e-c4c5c4f0aa79 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:09:19.978616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-75c695db-8c72-48aa-950e-c4c5c4f0aa79 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052790 Aug 17 20:09:19.979315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 292/594] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:09:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:20.919957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:20.920834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:20.929957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:20.930509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:20.930977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:20.931684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:20.932128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:20.932554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:21.149366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:21.157093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-37f85503-066a-4aec-90f4-dd0372755b16 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.243292 Aug 17 20:09:21.157713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 303/595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:20 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:21.335365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-79013758", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75cad640-8a23-42bc-b03e-d2829e6ee836"}], "security_groups": [{"name": "tempest-securitygroup--1012937987"}], "key_name": "tempest-keypair-1233152123", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:21.442046 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] validate_networks() for [('75cad640-8a23-42bc-b03e-d2829e6ee836', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:09:22.096628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:09:22.097282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:09:22.097964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:09:22.098591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:09:22.099268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:09:22.115088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:22.115657 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:22.116164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:22.116954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:22.117474 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:22.118040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:22.137036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:09:22.141262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:09:22.152650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:09:22.154989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:09:22.179318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:22.179916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:22.186569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:22.187942 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:22.188380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:22.189157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:22.189660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:22.190065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:22.200045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [dc8da4c4-75c5-43e8-85a6-1016e11513db] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:09:22.327875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:22.335906 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e28cd31c-7de0-438d-9693-7816241d82bb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.161096 Aug 17 20:09:22.336483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 304/596] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:22 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:23.212579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [dc8da4c4-75c5-43e8-85a6-1016e11513db] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44568. Aug 17 20:09:23.219745 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3fc685a8-09f7-4528-91d1-668da11fa263 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.888997 Aug 17 20:09:23.220784 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 293/597] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:09:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:09:23.233180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b95e1d23-79b6-4732-8417-0c4bed2853dc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:23.233886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b95e1d23-79b6-4732-8417-0c4bed2853dc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:23.300565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b95e1d23-79b6-4732-8417-0c4bed2853dc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:23.307638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b95e1d23-79b6-4732-8417-0c4bed2853dc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1240 microversion: 2.1 time: 0.078441 Aug 17 20:09:23.308214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 305/598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:23 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:23.357431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:23.358072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:23.364758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:23.365241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:23.365724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:23.366415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:23.366866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:23.367291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:23.504992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:23.512850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4901b533-a5ad-4650-82a8-c9d3a15c9ebb tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1678 microversion: 2.1 time: 0.159907 Aug 17 20:09:23.513420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 294/599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:23 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:24.331762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-96631c4f-3751-44ec-819b-ffaf1dbb76b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:24.332358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-96631c4f-3751-44ec-819b-ffaf1dbb76b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:24.389716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-96631c4f-3751-44ec-819b-ffaf1dbb76b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:24.396678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-96631c4f-3751-44ec-819b-ffaf1dbb76b1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1240 microversion: 2.1 time: 0.068797 Aug 17 20:09:24.397231 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 306/600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:24 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:24.541934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:24.542544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:24.549453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:24.549967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:24.550399 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:24.551423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:24.551934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:24.552355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:24.684030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:24.692257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e0778538-f532-4dc7-b1b5-f4bff953605a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1655 microversion: 2.1 time: 0.154246 Aug 17 20:09:24.692804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 295/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:24 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:24.712756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:24.719137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:24.719615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:24.720047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:24.742885 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Going to try to start instance {{(pid=120819) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 20:09:24.794913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-951ee09a-11e0-41ed-9aff-dee136ce4b05 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action" status: 202 len: 0 microversion: 2.1 time: 0.085730 Aug 17 20:09:24.795434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 307/602] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:09:24 2022] POST /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:09:24.804588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:24.805188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:24.811724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:24.812421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:24.812863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:24.813665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:24.814110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:24.814523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:24.949972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:24.958356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0d447c61-17ce-48ed-819a-8099a9e43749 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1664 microversion: 2.1 time: 0.158155 Aug 17 20:09:24.958857 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 296/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:24 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:25.420678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c6ac22a5-d99d-41d2-8464-55706eac51d6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:25.421456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c6ac22a5-d99d-41d2-8464-55706eac51d6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:25.479977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c6ac22a5-d99d-41d2-8464-55706eac51d6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:25.486818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c6ac22a5-d99d-41d2-8464-55706eac51d6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1240 microversion: 2.1 time: 0.073807 Aug 17 20:09:25.487391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 308/604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:25 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:25.982079 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:25.982992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:25.992599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:25.993122 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:25.993504 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:25.994252 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:25.994700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:25.995125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:26.135231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:26.143565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-71f2d21a-5b3c-4479-8132-8c169545dab7 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1664 microversion: 2.1 time: 0.167437 Aug 17 20:09:26.144752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 297/605] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:25 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:26.508002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b9a87d92-ee1c-4932-9c8e-349ce18107fc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:26.508601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b9a87d92-ee1c-4932-9c8e-349ce18107fc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:26.565781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b9a87d92-ee1c-4932-9c8e-349ce18107fc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:26.573563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b9a87d92-ee1c-4932-9c8e-349ce18107fc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1240 microversion: 2.1 time: 0.070118 Aug 17 20:09:26.574202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 309/606] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:26 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:27.168721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:27.169846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:27.181008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:27.181866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:27.182680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:27.184068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:27.184839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:27.185483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:27.321876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:27.329570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-da343d23-804e-4de9-8332-8a8d83119958 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1668 microversion: 2.1 time: 0.167419 Aug 17 20:09:27.330143 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 298/607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:27 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:27.598025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:27.598694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:27.609517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:27.610192 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:27.610758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:27.611695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:27.612282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:27.612816 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:27.682076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:27.690047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-81b00ba9-f73b-414f-9744-ce436632262e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1244 microversion: 2.1 time: 0.098279 Aug 17 20:09:27.690846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 310/608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:27 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:28.712316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:28.712914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:28.721521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:28.722170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:28.722649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:28.723554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:28.724216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:28.724798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:28.788542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:28.796253 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d3244ae6-a1e5-46a6-b0b2-5fb709a0bab4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1298 microversion: 2.1 time: 0.089042 Aug 17 20:09:28.796810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 299/609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:28 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:29.817771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:29.818372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:29.820904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:29.827113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:29.827507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:29.827979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:29.828669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:29.829157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:29.829564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:29.861087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a", "tag": "9254ffb6-c43e-4098-be6d-fa4f156b537a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:29.872279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:29.873091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:29.873908 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:29.887167 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] Creating event network-changed:9254ffb6-c43e-4098-be6d-fa4f156b537a for instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a on hv-cinder-82002 Aug 17 20:09:29.895581 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-ed75bb10-82d6-4aad-a282-078356c932bd req-85c12595-b22c-470f-ac43-61232c646809 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038941 Aug 17 20:09:29.897152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 300/610] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:09:29.986956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:29.994711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4888e55c-93fe-42a7-a53b-b06a91c67d10 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.180877 Aug 17 20:09:29.995261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 311/611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:29 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:31.020303 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:31.021616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:31.032728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:31.033530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:31.034580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:31.035732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:31.036602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:31.037302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:31.172418 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:31.180544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-50ea81a5-0ca7-416d-8490-c5850c6bf203 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.167279 Aug 17 20:09:31.181117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 301/612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:31 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:32.204602 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:32.205521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:32.215045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:32.215539 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:32.215970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:32.216660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:32.217101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:32.217520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:32.358292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:32.366398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-24d12014-5eae-43ce-a8c6-28e9ae90566a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.168324 Aug 17 20:09:32.366962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 312/613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:32 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:33.388424 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:33.389317 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:33.392598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:33.393512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=10 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:33.403708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:33.404478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:33.405226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:33.406464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:33.407289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:33.408000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:33.549300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:33.561313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e348aa41-5209-4fcc-a80b-30b82f765c6e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.177779 Aug 17 20:09:33.562051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 302/614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:33 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:34.582876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:34.583551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:34.590991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:34.591462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:34.591880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:34.592589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:34.593028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:34.593862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:34.731939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:34.739909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0190c176-1571-49c8-95a2-8d863cf01b11 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.160986 Aug 17 20:09:34.740447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 313/615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:34 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:35.763619 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:35.764315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:35.771962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:35.772512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:35.773020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:35.773836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:35.774351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:35.774892 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:35.911101 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:35.918817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c27b6130-c9c4-413c-ac57-7f4db9c3e7bc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.160812 Aug 17 20:09:35.919437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 303/616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:35 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:35.997705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a", "name": "network-vif-plugged", "status": "completed", "tag": "9254ffb6-c43e-4098-be6d-fa4f156b537a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:36.007156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:36.007628 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:36.008049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:36.019037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] Creating event network-vif-plugged:9254ffb6-c43e-4098-be6d-fa4f156b537a for instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a on hv-cinder-82002 Aug 17 20:09:36.023805 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-5ab991f5-8f49-4136-8553-0b9085433600 req-e4a1ebec-7751-456d-9538-c53b1ba6fa08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086180 Aug 17 20:09:36.024387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 314/617] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:36.944690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:36.945730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:36.956991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:36.957848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:36.958555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:36.959672 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:36.960386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:36.961068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:37.092573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:37.100058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-22bc980e-4635-4d2e-b932-e03ceba96093 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1366 microversion: 2.1 time: 0.161904 Aug 17 20:09:37.100615 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 304/618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:36 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:38.120030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=8 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:38.125755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:38.126532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:38.134494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:38.135057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:38.135559 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:38.136361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:38.136884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:38.137373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:38.267342 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:09:38.275311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ba288a3a-940e-4548-b43c-d94bf12eef0c tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1555 microversion: 2.1 time: 0.156708 Aug 17 20:09:38.275883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 315/619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:09:38 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:09:38.295495 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:09:38.296063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:09:38.298370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:09:38.305899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:38.306576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:38.307010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:38.307711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:38.308160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:38.308583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:38.392172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3113821c-82b0-4e7e-9ea5-d638a13bf19e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100302 Aug 17 20:09:38.393129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 305/620] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:09:38 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:09:39.344042 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a", "tag": "9254ffb6-c43e-4098-be6d-fa4f156b537a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:09:39.354454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:09:39.354918 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:09:39.355337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:09:39.366380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] Creating event network-changed:9254ffb6-c43e-4098-be6d-fa4f156b537a for instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a on hv-cinder-82002 Aug 17 20:09:39.371290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-1b35c095-9b54-49e9-a6c5-a7560c06b3af req-7289ad09-bf38-410f-872c-cf52566d7575 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030973 Aug 17 20:09:39.372114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 316/621] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:05.852355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=76 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:05.853156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:05.859241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:05.859921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:05.869607 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:05.870431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:05.870856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:05.871529 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:05.871968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:05.872378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:05.954476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lazy-loading 'services' on Instance uuid 5bc35c2c-0cce-43cb-b988-9920dfada09e {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:10:06.032270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d99e2747-1965-4977-abf6-a024afd55a5e tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments/ec74b424-0b36-4f8b-b9bc-af0d762c1989" status: 202 len: 0 microversion: 2.1 time: 0.182484 Aug 17 20:10:06.032856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 306/622] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:10:05 2022] DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments/ec74b424-0b36-4f8b-b9bc-af0d762c1989 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:10:06.042156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:06.044528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:06.046993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=11 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:06.047760 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:06.053268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:06.053856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:06.054307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:06.055024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:06.055467 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:06.055879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:06.088762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4eb30e70-36ca-476a-b43f-486ec479d295 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050781 Aug 17 20:10:06.089264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 317/623] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:10:06 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:07.102896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:07.106410 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:07.113483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.113996 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.114419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.115110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.115550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.115958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.147223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-240d28a2-7306-4d47-8b8b-2fc62a27b2fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049455 Aug 17 20:10:07.147767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 307/624] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:10:07 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:10:07.234936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:07.235487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:07.242005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.242534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.242960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.243672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.244117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.244537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.269590 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:10:07.348388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-267eeeb1-ac6e-4fbd-80da-499c3e0fbed5 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 204 len: 0 microversion: 2.1 time: 0.117141 Aug 17 20:10:07.348965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 318/625] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:10:07 2022] DELETE /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:10:07.357117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:07.357750 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:07.364201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.364690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.365099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.365824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:07.366261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:07.366669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:07.523232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:07.531129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5da685ca-9b53-4470-84bd-09388d1441fb tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1689 microversion: 2.1 time: 0.177999 Aug 17 20:10:07.531719 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 308/626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:07 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:08.556781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:08.558068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:08.565055 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:08.565594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:08.566001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:08.566690 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:08.567134 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:08.567541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:08.700085 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:08.707931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-84b46a63-632f-45d4-b9d7-c850d6864a85 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1689 microversion: 2.1 time: 0.158602 Aug 17 20:10:08.708509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 319/627] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:08 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:09.734475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:09.735426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:09.746429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:09.747235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:09.747963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:09.749103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:09.749918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:09.750738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:09.896727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:09.908783 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-74b6dfcc-e05e-4d7a-880e-3803930fa8fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1689 microversion: 2.1 time: 0.180595 Aug 17 20:10:09.909644 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 309/628] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:09 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:10.934653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:10.935410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:10.943813 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:10.944410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:10.944957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:10.945967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:10.946527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:10.947053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:11.083006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:11.091021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d4493cf4-65b0-40dc-8963-183be2c7a9ce tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1689 microversion: 2.1 time: 0.162547 Aug 17 20:10:11.091595 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 320/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:10 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:12.022587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc35c2c-0cce-43cb-b988-9920dfada09e", "name": "network-vif-deleted", "tag": "42d6ffa6-98cb-437f-ab81-e3ea5b90a866"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:12.039255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:12.039880 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:12.040347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:12.057285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] Creating event network-vif-deleted:42d6ffa6-98cb-437f-ab81-e3ea5b90a866 for instance 5bc35c2c-0cce-43cb-b988-9920dfada09e on hv-cinder-82002 Aug 17 20:10:12.062836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-bdcd5e90-2b07-492f-91d5-2e050a1d5b47 req-4e9d4fd4-64b8-4562-8fb6-a30a0e6aa9f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044009 Aug 17 20:10:12.064238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 310/630] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:12.113941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:12.115138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:12.123062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:12.123842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:12.124265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:12.125232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:12.125725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:12.126147 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:12.192085 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:12.202151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6262b0c7-28bd-40de-83d6-9923a8ea4c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 200 len: 1331 microversion: 2.1 time: 0.091798 Aug 17 20:10:12.213570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 321/631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:12 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:13.228723 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:13.229759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 5bc35c2c-0cce-43cb-b988-9920dfada09e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:13.239282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:13.240043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:13.240739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:13.241827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:13.242547 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:13.243217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:13.257790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] HTTP exception thrown: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Request method failure captured: Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e HTTP/1.1 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul1u0HN3oVR4RMY3Y3Cwi5A2gROomyi7Pi_hTbKDQYA_MRp7kiAx32AFB0ALGZyKk9lKXdsUowEfi26IaD7JWg1eUDRx3aOoyYhtWh--oqyrggBCO3BS1JOqkKY77Dw32XdudJqQtKW20QIbdjd63bWT9_vqQC6URXDSCDvKzbsFY4 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:10:13.259392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/db932807b4634440ba61a82446e82874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_db932807b4634440ba61a82446e82874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: a5aece8a7f2342cfabd9a3f8707a4470 Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. Aug 17 20:10:13.260919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '5bc35c2c-0cce-43cb-b988-9920dfada09e'} Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:10:13.261944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. Aug 17 20:10:13.263425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:13.264979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Returning 404 to user: Instance 5bc35c2c-0cce-43cb-b988-9920dfada09e could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:10:13.264979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf00956c-9063-4a24-9b0e-5f1751c895fc tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e" status: 404 len: 111 microversion: 2.1 time: 0.040036 Aug 17 20:10:13.264979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 311/632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:13 2022] GET /compute/v2.1/servers/5bc35c2c-0cce-43cb-b988-9920dfada09e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:10:13.269748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1b85c2c0-ee14-4c94-8c84-a0da6d8b2b47 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '.version_select at 0x7faaad317940>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:13.291533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1b85c2c0-ee14-4c94-8c84-a0da6d8b2b47 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931801825" status: 202 len: 0 microversion: 2.1 time: 0.025388 Aug 17 20:10:13.292098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 322/633] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 17 20:10:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931801825 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:10:16.173201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:16.173793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:16.181096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:16.181566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:16.182021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:16.182729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:16.183198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:16.183616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:16.208686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:10:16.297355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4e9b7711-e943-483a-94fe-ddd339150487 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 204 len: 0 microversion: 2.1 time: 0.127550 Aug 17 20:10:16.298259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 312/634] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:10:16 2022] DELETE /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:10:16.307868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:16.308442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:16.315143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:16.315617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:16.316045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:16.316728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:16.317173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:16.317611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:16.462037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:16.469911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2c282bf1-7cba-4351-afb4-fced7f194c5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1509 microversion: 2.1 time: 0.166810 Aug 17 20:10:16.470482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 323/635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:16 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:10:17.492034 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:17.492707 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:17.499408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:17.499890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:17.500319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:17.501009 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:17.501485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:17.501901 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:17.658933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:17.664397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d340e8f6-36d5-46e1-ac27-57e642dc2204", "name": "network-vif-deleted", "tag": "0443d835-baf6-4a9e-9a6b-41d106c3e3af"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:17.666845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa523ea6-9b37-44d3-90e2-1cd4bd79b22a tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 200 len: 1509 microversion: 2.1 time: 0.179352 Aug 17 20:10:17.667434 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 313/636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:17 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:17.686786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:17.687302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:17.687719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:17.702529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] Creating event network-vif-deleted:0443d835-baf6-4a9e-9a6b-41d106c3e3af for instance d340e8f6-36d5-46e1-ac27-57e642dc2204 on hv-cinder-82002 Aug 17 20:10:17.711045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-e3bd77f3-e458-4d64-a47d-2f0943658fd6 req-fff2940e-9019-47ea-989e-26f34860d5ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050442 Aug 17 20:10:17.712464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 324/637] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:18.692635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:18.693625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: d340e8f6-36d5-46e1-ac27-57e642dc2204] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:18.702624 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.703093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.703520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:18.704199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.704637 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.705050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:18.718872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] HTTP exception thrown: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Request method failure captured: Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 HTTP/1.1 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul1u0HN3oVR4RMY3Y3Cwi5A2gROomyi7Pi_hTbKDQYA_MRp7kiAx32AFB0ALGZyKk9lKXdsUowEfi26IaD7JWg1eUDRx3aOoyYhtWh--oqyrggBCO3BS1JOqkKY77Dw32XdudJqQtKW20QIbdjd63bWT9_vqQC6URXDSCDvKzbsFY4 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:10:18.720636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/db932807b4634440ba61a82446e82874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_db932807b4634440ba61a82446e82874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: a5aece8a7f2342cfabd9a3f8707a4470 Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. Aug 17 20:10:18.722132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': 'd340e8f6-36d5-46e1-ac27-57e642dc2204'} Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:10:18.723058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. Aug 17 20:10:18.724603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:18.726083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Returning 404 to user: Instance d340e8f6-36d5-46e1-ac27-57e642dc2204 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:10:18.726083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-657d0ed5-0337-41ad-9838-0501bb0ca0aa tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204" status: 404 len: 111 microversion: 2.1 time: 0.036056 Aug 17 20:10:18.726083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 314/638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:18 2022] GET /compute/v2.1/servers/d340e8f6-36d5-46e1-ac27-57e642dc2204 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:10:18.731949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:18.732520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:18.738635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.739103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.739522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:18.740195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.740636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.741045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:18.765799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:10:18.853067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6094407e-dddf-40c9-8449-03ec69789a32 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 204 len: 0 microversion: 2.1 time: 0.125750 Aug 17 20:10:18.853718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 325/639] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:10:18 2022] DELETE /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:10:18.864144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:18.865135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:18.871515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.871981 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.872412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:18.873099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:18.873564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:18.874026 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:19.009675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:19.017249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-68f7fcb0-a158-4f19-b942-5ace37474623 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.157694 Aug 17 20:10:19.017887 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 315/640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:18 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:20.038700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:20.039496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:20.046362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:20.046966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:20.047465 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:20.048230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:20.048743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:20.049222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:20.187231 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:20.195181 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4251a491-631d-488c-ab52-ec9e9079fc5d tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1522 microversion: 2.1 time: 0.160780 Aug 17 20:10:20.195786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 326/641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:20 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:20.884982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce34927-ae61-472f-b875-805b71bd8c12", "name": "network-vif-deleted", "tag": "bb10f8d3-1fb6-4d69-a12a-50b827572b4b"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:20.897326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:20.897814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:20.898230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:20.910466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] Creating event network-vif-deleted:bb10f8d3-1fb6-4d69-a12a-50b827572b4b for instance 2ce34927-ae61-472f-b875-805b71bd8c12 on hv-cinder-82002 Aug 17 20:10:20.916562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-94667643-f403-498b-830a-55e95ac5f697 req-115d66b7-8b3e-46d3-ae06-1a23b8731fed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035037 Aug 17 20:10:20.917433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 316/642] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:21.216391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:21.217000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:21.224023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:21.224503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:21.224934 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:21.225641 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:21.226296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:21.226716 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:21.263351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:21.263836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:21.264243 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:21.264698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lazy-loading 'fault' on Instance uuid 2ce34927-ae61-472f-b875-805b71bd8c12 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:10:21.307471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5aece8a7f2342cfabd9a3f8707a4470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db932807b4634440ba61a82446e82874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:21.314989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bb383263-3a22-45be-81b6-9a955940b8f0 tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 200 len: 1312 microversion: 2.1 time: 0.102643 Aug 17 20:10:21.315558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 327/643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:21 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:22.340793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:22.341720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] [instance: 2ce34927-ae61-472f-b875-805b71bd8c12] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:22.350318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:22.350897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:22.351429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:22.352276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:22.352832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:22.353356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:22.369905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] HTTP exception thrown: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Request method failure captured: Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 HTTP/1.1 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul1u0HN3oVR4RMY3Y3Cwi5A2gROomyi7Pi_hTbKDQYA_MRp7kiAx32AFB0ALGZyKk9lKXdsUowEfi26IaD7JWg1eUDRx3aOoyYhtWh--oqyrggBCO3BS1JOqkKY77Dw32XdudJqQtKW20QIbdjd63bWT9_vqQC6URXDSCDvKzbsFY4 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:10:22.371680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/db932807b4634440ba61a82446e82874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_db932807b4634440ba61a82446e82874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/db932807b4634440ba61a82446e82874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: db932807b4634440ba61a82446e82874 Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2091268675 Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: a5aece8a7f2342cfabd9a3f8707a4470 Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2091268675-project Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. Aug 17 20:10:22.373196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '2ce34927-ae61-472f-b875-805b71bd8c12'} Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:10:22.374066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. Aug 17 20:10:22.375627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:10:22.377216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] Returning 404 to user: Instance 2ce34927-ae61-472f-b875-805b71bd8c12 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:10:22.377216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-91b5ddd1-d5e9-4e1e-b25f-85fa34e9efec tempest-ServerRescueNegativeTestJSON-2091268675 tempest-ServerRescueNegativeTestJSON-2091268675-project] 10.222.0.18 "GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12" status: 404 len: 111 microversion: 2.1 time: 0.038927 Aug 17 20:10:22.377216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 317/644] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:22 2022] GET /compute/v2.1/servers/2ce34927-ae61-472f-b875-805b71bd8c12 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:10:30.526833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:30.529261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:30.535979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.536609 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.537137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.537980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.543011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.543545 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.577190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f101db83-35a1-4d83-9cbc-a41a4a4f69ec tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054519 Aug 17 20:10:30.582857 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 328/645] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:10:30 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:10:30.645402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:30.646033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:30.652948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.653435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.655930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.656657 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.657112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.657755 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.685001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:10:30.783417 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b14bda0-a629-4b8a-9ce0-8a2437421f11 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 204 len: 0 microversion: 2.1 time: 0.141641 Aug 17 20:10:30.784659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 318/646] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:10:30 2022] DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:10:30.793258 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:30.793905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:30.802802 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.803290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.803720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.804429 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:30.804872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:30.805291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:30.982675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:30.992898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-261bf106-6bfc-4582-82cb-85da6202a6a8 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1674 microversion: 2.1 time: 0.203810 Aug 17 20:10:31.007054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 329/647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:30 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:31.243281 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e7aee9f3-fb1e-4005-b790-d77d42f6b6c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: .version_select at 0x7faaacee3af0>, body: {"keypair": {"name": "tempest-keypair-1600328072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWLXxIHqEvtS5K8N6mWdQbmO9nRxCk+GPh7+c9IJrABYDUU9oxi8DsAJvSRQmEuqSDTFwFN0TQ3HEPh4OElMHmy7p0y+EcxEhOr3VvWXfFHv6qcZa3TzmuOMLGzC2FNog=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:31.260127 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-e7aee9f3-fb1e-4005-b790-d77d42f6b6c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:10:31.264667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-e7aee9f3-fb1e-4005-b790-d77d42f6b6c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for user 31a49b84974b480985d0b002fc740e95 and project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:10:31.290718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e7aee9f3-fb1e-4005-b790-d77d42f6b6c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.184824 Aug 17 20:10:31.291547 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 319/648] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 17 20:10:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 20:10:32.015207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:32.015832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:32.022830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:32.024247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:32.024789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:32.025782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:32.026366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:32.026901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:32.165681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:32.173246 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b501f151-331a-4c91-a58c-9b53725f072e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1674 microversion: 2.1 time: 0.162077 Aug 17 20:10:32.173848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 330/649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:32 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:32.766745 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1923956741", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "689d8a20-5541-478f-99a7-dc99fc001e66"}], "security_groups": [{"name": "tempest-securitygroup--636229835"}], "key_name": "tempest-keypair-1600328072", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:32.878756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] validate_networks() for [('689d8a20-5541-478f-99a7-dc99fc001e66', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:10:33.195567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:33.196791 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:33.208562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:33.209056 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:33.209494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:33.212491 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:33.212921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:33.213408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:33.260650 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:33.334030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:33.345770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5a49effb-a9d9-4122-b6c3-9b75135bc21b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 200 len: 1606 microversion: 2.1 time: 0.154815 Aug 17 20:10:33.359479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 331/650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:33 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 1606 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:33.377881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:10:33.378554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:10:33.379196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:10:33.379660 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:10:33.380069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:10:33.390226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:33.391038 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:33.391627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:33.392521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:33.393453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:33.394133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:33.412992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:10:33.418753 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for user 31a49b84974b480985d0b002fc740e95 and project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:10:33.435848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:10:33.438490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:10:33.479917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fcce73-27be-4ef7-a694-4e85c4d9ca67", "name": "network-vif-deleted", "tag": "3258afea-705c-4b3a-9b43-978ed770565c"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:33.498954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:33.499432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:33.499862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:33.507585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b6795436-495b-4299-81da-5a4f15e6cf5d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.745626 Aug 17 20:10:33.509080 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 320/651] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 17 20:10:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 20:10:33.519736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] Creating event network-vif-deleted:3258afea-705c-4b3a-9b43-978ed770565c for instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 on hv-cinder-82002 Aug 17 20:10:33.524196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:33.526438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:33.542746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-e19a44db-2120-4412-bbab-9cd8059ddf63 req-aad88d86-ac40-4b18-982a-74b222da6b3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063308 Aug 17 20:10:33.542746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 332/652] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:10:33.594042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:33.606462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:33.608691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:33.610183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-585c95de-443b-49c2-993a-5b1de4125125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1282 microversion: 2.20 time: 0.094280 Aug 17 20:10:33.611192 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 321/653] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:33 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:10:34.368451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:34.369350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:34.377638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:34.378376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:34.379143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:34.380017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:34.380632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:34.381059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:34.395701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 HTTP/1.1 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:10:34.398071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:10:34.399581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '32fcce73-27be-4ef7-a694-4e85c4d9ca67'} Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:10:34.400811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:10:34.403129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:10:34.404589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:10:34.404589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-aba22628-c489-40dd-a0c1-e45ea608395e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 404 len: 111 microversion: 2.1 time: 0.035824 Aug 17 20:10:34.404589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 333/654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:34 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:10:34.410409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e38ce3e8-6179-425d-a32f-512269dee34e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '.version_select at 0x7faaacb8bb80>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:34.436230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e38ce3e8-6179-425d-a32f-512269dee34e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913208509" status: 202 len: 0 microversion: 2.1 time: 0.030558 Aug 17 20:10:34.441050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 322/655] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 17 20:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913208509 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:10:34.632903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:34.633814 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:34.653943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:34.656741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:34.657357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:34.658740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:34.659493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:34.660239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:34.778947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:34.797079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:34.803068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:34.804919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e4dddbea-7d19-4b27-a615-2bb6a0be95c1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1334 microversion: 2.20 time: 0.176337 Aug 17 20:10:34.806222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 334/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:34 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:35.230076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a55d5b0-524d-4270-8c93-3ea144414404 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: .version_select at 0x7faaacbe30d0>, body: {"keypair": {"name": "tempest-keypair-570547384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAx/xpH6sEeTf14WQ6kyx5fTUANQhnYyEGzSjEHCrCOplm80syDLnS7zFjW5wa4YK7nbxemDr+nLyZeCdZ+QmVk+6HWysL5SyT1iN65FOD7SrRRzBiUmHH34UAxxKoy9w=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:35.247297 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-6a55d5b0-524d-4270-8c93-3ea144414404 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for project da5173bee1cf4ec09240370892c5b9e3. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:10:35.253040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-6a55d5b0-524d-4270-8c93-3ea144414404 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for user 3a40f55377b64f6f93784eefaf28152e and project da5173bee1cf4ec09240370892c5b9e3. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:10:35.286978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6a55d5b0-524d-4270-8c93-3ea144414404 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060719 Aug 17 20:10:35.287684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 323/657] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:10:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:35.829512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:35.830803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:35.842451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:35.842910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:35.843541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:35.844656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:35.844656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:35.845224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:35.998943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:36.007892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:36.009494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:36.010754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0e7056cf-2dfc-4ff9-82a4-197cdbd3d11f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.186176 Aug 17 20:10:36.011490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 335/658] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:35 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:37.034328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:37.035075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:37.037804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:37.047157 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:37.047696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:37.048292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:37.048956 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:37.049584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:37.050150 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:37.055385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:37.189359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:37.212637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:37.217584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:37.218635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:37.219290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:37.224207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:37.238581 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:37.243958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:37.245358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2c449bf9-74a6-4633-8186-7243f56536a1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.215543 Aug 17 20:10:37.248263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 324/659] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:37 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:37.262668 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] Creating event network-changed:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:10:37.269908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-837685a7-b52a-44d6-b09d-5b84697cb0ac req-44526d8f-58cd-4418-b9bb-b70b02402e21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094272 Aug 17 20:10:37.270663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 336/660] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:10:37.859445 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-478115767", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a2a392e-41f1-44dd-86d2-0bb085abeaad"}], "security_groups": [{"name": "tempest-securitygroup--241304822"}], "key_name": "tempest-keypair-570547384", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:37.962650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] validate_networks() for [('1a2a392e-41f1-44dd-86d2-0bb085abeaad', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:10:38.270739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:38.271358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:38.278099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:38.278571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:38.278996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:38.279663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:38.280101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:38.280508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:38.353519 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:10:38.354030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:10:38.354523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:10:38.354935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:10:38.355394 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:10:38.364840 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:38.365327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:38.365830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:38.366681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:38.367190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:38.367612 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:38.384995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for project da5173bee1cf4ec09240370892c5b9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:10:38.389369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Getting quotas for user 3a40f55377b64f6f93784eefaf28152e and project da5173bee1cf4ec09240370892c5b9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:10:38.401965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:10:38.404236 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:10:38.421643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:38.430163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:38.431715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:38.432843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-92ff1848-d581-4ba9-af5e-225d3343791d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.166948 Aug 17 20:10:38.434368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 337/661] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:38 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:10:38.453843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8ae13f0-2f13-4670-8dfe-75cc76dcb41a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598653 Aug 17 20:10:38.454623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 325/662] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:10:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:10:38.465357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8b641bf0-1ba4-4cb5-a831-8e97a764f614 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:38.466090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8b641bf0-1ba4-4cb5-a831-8e97a764f614 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:38.518825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8b641bf0-1ba4-4cb5-a831-8e97a764f614 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:38.525907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8b641bf0-1ba4-4cb5-a831-8e97a764f614 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1236 microversion: 2.1 time: 0.064290 Aug 17 20:10:38.526437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 338/663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:38 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:10:39.457348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:39.458063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:39.464852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:39.465330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:39.465792 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:39.466514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:39.466994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:39.467408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:39.546316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:39.546896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:39.553756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:39.554227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:39.554648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:39.555319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:39.555771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:39.556179 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:39.608238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:39.616402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:39.617921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:39.619019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ae12065d-5d68-4a15-b5e0-286d1a98796d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.166212 Aug 17 20:10:39.619598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 326/664] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:39 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:39.628205 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:39.638328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-cbfce50e-a238-45e6-979d-d2ca2065ac57 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1240 microversion: 2.1 time: 0.096405 Aug 17 20:10:39.638873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 339/665] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:39 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:10:40.646109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:40.647793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:40.654897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:40.655447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:40.656144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:40.656899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:40.657565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:40.658053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:40.658936 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:40.659546 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:40.666583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:40.667065 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:40.667496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:40.668237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:40.668686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:40.669102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:40.767524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:40.776513 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d91ba760-7275-43e0-bba5-802da83caf51 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1296 microversion: 2.1 time: 0.121490 Aug 17 20:10:40.777567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 340/666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:40 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:40.829348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:40.839226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:40.840979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:40.842179 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b605a1bb-5bf7-4e01-a84e-973f6ecff743 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.200315 Aug 17 20:10:40.842940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 327/667] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:40 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:41.798644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:41.799389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:41.806638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:41.807264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:41.807719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:41.808472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:41.809014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:41.809484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:41.864544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:41.865380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:41.873314 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:41.874120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:41.874800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:41.875608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:41.876123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:41.876583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:41.983130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:41.993353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-48522683-fd8f-4016-9941-45017b331102 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.198789 Aug 17 20:10:42.006673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 341/668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:41 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:42.034237 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:42.042220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:42.043959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:42.045066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca122997-412c-4427-8862-7a1c925fab0b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.184519 Aug 17 20:10:42.045661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 328/669] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:41 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:42.201698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2891ed34-b8f6-4ebf-b2a6-5b4089050186", "tag": "b4256248-9b5e-475a-bb4b-b0253e43b49e"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:42.211821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:42.212421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:42.212924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:42.224220 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] Creating event network-changed:b4256248-9b5e-475a-bb4b-b0253e43b49e for instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 on hv-cinder-82002 Aug 17 20:10:42.229037 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-a0357e56-76ed-4ca0-8d96-a7f713f1ba0b req-e285302a-769e-4447-992b-1d9523aaf64f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031216 Aug 17 20:10:42.229831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 342/670] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:42.389864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "name": "network-vif-plugged", "status": "completed", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:42.401879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:42.402471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:42.402917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:42.414725 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] Creating event network-vif-plugged:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:10:42.419647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-48692f62-12cd-4a40-85f9-906bd2ee33ea req-ab48b14b-927e-4e23-be77-91ebad9c925f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 17 20:10:42.420490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 329/671] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:43.015683 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:43.016383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:43.023407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:43.023888 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:43.024319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:43.025050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:43.025485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:43.025930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:43.069206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:43.069929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:43.076657 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:43.077138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:43.077562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:43.078546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:43.078699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:43.079159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:43.214153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:43.222523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-45d0e2c2-7fd8-4093-b2fe-ef2588bb457f tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.211456 Aug 17 20:10:43.223236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 343/672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:43 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:43.242398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:43.250893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:43.252376 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:43.253478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6836840e-dbe9-40d1-bb80-eacbbd34c5ff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.189023 Aug 17 20:10:43.254084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 330/673] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:43 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:10:44.247483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:44.248355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:44.259457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:44.260299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:44.261019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:44.262203 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:44.262945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:44.263589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:44.275794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:44.277029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:44.283907 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:44.284378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:44.284803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:44.285514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:44.286056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:44.286452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:44.452290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:44.460637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e810f11f-70fd-40b6-bdab-8bda0cc18c6b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.219915 Aug 17 20:10:44.461320 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 344/674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:44 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:44.467413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:44.475468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:44.476964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:44.478095 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ff0fe56a-9a4c-4ab0-acd2-eee12ad933c2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.206195 Aug 17 20:10:44.478655 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 331/675] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:44 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:45.486899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:45.487876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:45.498391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:45.498868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:45.499296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:45.499984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:45.500427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:45.500843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:45.501928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:45.502534 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:45.509512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:45.510028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:45.510455 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:45.511145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:45.511586 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:45.512001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:45.700475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:45.703985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:45.708856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ac34d8e6-2ffc-4e98-a384-c0c97be8c96a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.228621 Aug 17 20:10:45.709818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 345/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:45 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:45.713158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:45.714670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:45.715958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cf1bf92f-6646-4378-bd39-1ceacec230fd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1407 microversion: 2.20 time: 0.218188 Aug 17 20:10:45.716678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 332/677] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:45 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:46.734021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:46.734929 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:46.743569 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:46.744561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:46.745849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:46.747697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:46.747697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:46.748209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:46.748649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:46.749082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:46.752770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:46.753482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:46.754106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:46.754988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:46.755436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:46.755849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:47.172863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:47.175997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:47.180971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4f2ea39f-6323-42c8-963d-807a20a9187e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.453523 Aug 17 20:10:47.181575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 346/678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:46 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:47.184954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:47.186480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:47.187661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f702da8b-2995-46e7-a67c-ee48a206fe29 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1598 microversion: 2.20 time: 0.450747 Aug 17 20:10:47.188173 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 333/679] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:10:46 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1598 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:10:47.209416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:47.209921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:47.216067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:47.216543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:47.216965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:47.217675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:47.218119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:47.218526 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:47.304254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-73a899a9-3f16-49bb-8e71-4d785bceed28 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098235 Aug 17 20:10:47.305076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 347/680] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 17 20:10:47 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:10:48.201583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:48.202177 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:48.208708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:48.209173 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:48.209614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:48.210325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:48.210770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:48.211188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:48.315980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:48.325682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:48.326397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:48.327022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:48.340316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] Creating event network-changed:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:10:48.345261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-f6386919-9862-4ec0-9e1a-26100b5f8828 req-d987e082-1d5d-42fd-ab3b-ccf3be2ade0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Aug 17 20:10:48.346282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 348/681] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:48.373146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:48.375553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:48.381725 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8d1d08d-de5b-4979-9f38-4f38f54e2ccc tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.183961 Aug 17 20:10:48.382396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 334/682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:48 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:48.640736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:48.646486 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ed34-b8f6-4ebf-b2a6-5b4089050186", "name": "network-vif-plugged", "status": "completed", "tag": "b4256248-9b5e-475a-bb4b-b0253e43b49e"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:48.658617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:48.659161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:48.659725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:48.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] Creating event network-vif-plugged:b4256248-9b5e-475a-bb4b-b0253e43b49e for instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 on hv-cinder-82002 Aug 17 20:10:48.678329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-5592a2e7-5491-40a4-b25d-76832e77de36 req-2e80fd28-d758-414c-af85-eb84239d4f10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038592 Aug 17 20:10:48.679254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 349/683] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:10:49.402522 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:49.403134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:49.405416 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=22 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:49.412554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:49.413035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:49.413473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:49.414200 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:49.414654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:49.415113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:49.552996 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:49.560903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b324b45-2216-4ee4-8ebf-abde4a08c7ff tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1361 microversion: 2.1 time: 0.162484 Aug 17 20:10:49.561598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 335/684] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:49 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:50.586452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:50.587196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:50.594670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:50.595144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:50.595570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:50.596252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:50.596703 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:50.597120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:50.743732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:10:50.751643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fbaae8c8-1bbd-44ec-bc52-c2620e330838 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1548 microversion: 2.1 time: 0.172534 Aug 17 20:10:50.752207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 350/685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:10:50 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:10:50.774441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:50.774949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:50.782666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:50.783138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:50.783566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:50.784242 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:50.784692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:50.785107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:50.867971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-28fa0c3f-7223-41bb-86dd-565b468ad3c2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099552 Aug 17 20:10:50.868848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 336/686] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:10:50 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:51.840582 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2891ed34-b8f6-4ebf-b2a6-5b4089050186", "tag": "b4256248-9b5e-475a-bb4b-b0253e43b49e"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:51.850033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:51.850534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:51.850955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:51.861697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] Creating event network-changed:b4256248-9b5e-475a-bb4b-b0253e43b49e for instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 on hv-cinder-82002 Aug 17 20:10:51.866530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-858d70b3-70cf-4786-bfae-2a37039669ae req-7e2457be-427f-476a-a227-17208575bdc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029875 Aug 17 20:10:51.867112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 351/687] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:55.334678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:10:55.335353 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:55.343651 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:55.344282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:55.344850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:55.345801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:55.346388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:55.346978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:55.373636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dc8f69c2-26a5-4bad-b088-346ed3ad3349 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/ips" status: 200 len: 149 microversion: 2.1 time: 0.045797 Aug 17 20:10:55.374206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 337/688] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:10:55 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:10:56.721035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c01de44-c9ba-422d-90bc-9b000a939402"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:10:56.723483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:10:56.729845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:56.730326 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:56.730753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:56.731433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:10:56.731873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:10:56.732283 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:10:57.015364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:10:57.027697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e2fd062a-045c-4371-8ded-67c236ae74c2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311430 Aug 17 20:10:57.028313 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 352/689] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:10:56 2022] POST /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:04.608385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c01de44-c9ba-422d-90bc-9b000a939402"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:04.610853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:04.617664 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.618140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.618566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:04.619247 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.619714 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.620104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:04.701112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: POST /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments HTTP/1.1 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 74 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:11:04.702889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {"volumeAttachment": {"volumeId": "7c01de44-c9ba-422d-90bc-9b000a939402"}} Aug 17 20:11:04.704347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'server_id': 'a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a', 'body': {'volumeAttachment': {'volumeId': '7c01de44-c9ba-422d-90bc-9b000a939402'}}} Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:04.705232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:04.707210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 400 to user: Invalid volume: volume 7c01de44-c9ba-422d-90bc-9b000a939402 is already attached to instances: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-da1e6279-0831-4731-b1d8-9cae60a53843 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100116 Aug 17 20:11:04.709029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 338/690] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:11:04 2022] POST /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:11:04.780248 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:04.780798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:04.789741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.790242 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.790664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:04.791341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.791779 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.792186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:04.882834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'services' on Instance uuid a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:11:04.967806 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f095630f-4be2-499e-944c-5e6e07cc74d4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments/7c01de44-c9ba-422d-90bc-9b000a939402" status: 202 len: 0 microversion: 2.1 time: 0.195411 Aug 17 20:11:04.968494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 353/691] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:11:04 2022] DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments/7c01de44-c9ba-422d-90bc-9b000a939402 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:11:04.977049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:04.979368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:04.986565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.987044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.987560 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:04.988364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:04.988806 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:04.989218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:05.019258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5d653702-cec6-47ce-abb4-ded05a94ebdc tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Aug 17 20:11:05.019794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 339/692] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:11:04 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:06.032057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:06.034419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:06.041149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.041649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.042075 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.042759 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.043233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.043614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.072928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4a2d6b19-7bb5-406e-a295-b5132432f4a2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045698 Aug 17 20:11:06.073482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 354/693] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:11:06 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:11:06.135835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:06.136372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:06.142718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.143199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.143632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.144355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.144806 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.145233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.171378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:11:06.254072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-64e217cd-c61f-4e95-afb9-cdd5fb7dee9e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 204 len: 0 microversion: 2.1 time: 0.122154 Aug 17 20:11:06.254765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 340/694] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:11:06 2022] DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:11:06.263821 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:06.264461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:06.270508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.271005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.271434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.272116 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:06.272564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:06.272985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:06.402858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:06.414685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-394517f6-af97-4617-ac60-f7d65e6f92a6 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1680 microversion: 2.1 time: 0.154686 Aug 17 20:11:06.415484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 355/695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:06 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:07.441675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:07.442794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:07.446920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:07.455915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:07.456691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:07.457414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:07.458580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:07.459323 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:07.459955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:07.464928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:07.598298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:07.606889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7ebb1145-272a-4cea-a78c-d2ca457b68aa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1680 microversion: 2.1 time: 0.172262 Aug 17 20:11:07.607457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 341/696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:07 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:08.641844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:08.642805 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:08.646681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=42 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:08.653370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:08.653875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:08.654302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:08.654993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:08.655442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:08.655852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:08.789692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:08.797360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0e7ad937-05aa-4d37-b78c-1775fea59f90 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1680 microversion: 2.1 time: 0.163939 Aug 17 20:11:08.798048 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 356/697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:08 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:09.505348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a", "name": "network-vif-deleted", "tag": "9254ffb6-c43e-4098-be6d-fa4f156b537a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:09.516127 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:09.516639 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:09.517071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:09.530865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] Creating event network-vif-deleted:9254ffb6-c43e-4098-be6d-fa4f156b537a for instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a on hv-cinder-82002 Aug 17 20:11:09.536356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-93141d00-3292-4595-9378-e2afdbf53790 req-c86d154f-e2cf-44e5-9090-34648028bec9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040293 Aug 17 20:11:09.537660 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 342/698] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:09.819449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:09.819990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:09.827083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:09.827576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:09.828011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:09.828711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:09.829166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:09.829612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:09.860989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:09.861380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:09.861843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:09.862292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'fault' on Instance uuid a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:11:09.903686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:09.912352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a35617c9-4e2d-4013-a8cd-8a051266a5ad tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 200 len: 1330 microversion: 2.1 time: 0.096973 Aug 17 20:11:09.913316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 357/699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:09 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:10.939046 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:10.940188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:10.951547 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:10.952330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:10.953046 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:10.954211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:10.954955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:10.955641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:10.971367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a HTTP/1.1 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:11:10.972999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:11:10.974415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a'} Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:11:10.975233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:11:10.977125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:11:10.979010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:11:10.979010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-343fdf58-480a-4bf9-ae4a-bd0db46668ca tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 404 len: 111 microversion: 2.1 time: 0.042518 Aug 17 20:11:10.979010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 343/700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:10 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:11:10.983503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0132c355-54df-4535-b1a7-9164fccf74eb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '.version_select at 0x7faaad3173a0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:11.005068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0132c355-54df-4535-b1a7-9164fccf74eb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233152123" status: 202 len: 0 microversion: 2.1 time: 0.025434 Aug 17 20:11:11.005652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 358/701] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 17 20:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233152123 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:11:11.887262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-62222476-c487-4ae9-96c2-6aa3659bc10b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: .version_select at 0x7faaacb13ca0>, body: {"keypair": {"name": "tempest-keypair-31353342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfvA0qVFCGBOwdW97K5HJJCn9XZL958ZUvn48xIRKewL/iMtCal444c4HG5dVRKaYIRVV5ocfFDQd7HPBuU91m2ixO/bw14PHwqCW5x8WfOdmAzkFxp0E5P0g1x8rqp5Q=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:11.904548 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-62222476-c487-4ae9-96c2-6aa3659bc10b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:11:11.908946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-62222476-c487-4ae9-96c2-6aa3659bc10b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:11:11.935835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-62222476-c487-4ae9-96c2-6aa3659bc10b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.052417 Aug 17 20:11:11.936450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 344/702] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:11:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:13.287677 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-217974251", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75cad640-8a23-42bc-b03e-d2829e6ee836"}], "security_groups": [{"name": "tempest-securitygroup--461461126"}], "key_name": "tempest-keypair-31353342", "user_data": "}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:13.395580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] validate_networks() for [('75cad640-8a23-42bc-b03e-d2829e6ee836', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:11:13.898066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:11:13.898691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:11:13.899137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:11:13.899538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:11:13.899944 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:11:13.909575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:13.910053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:13.910476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:13.911171 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:13.911597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:13.912014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:13.929807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:11:13.933985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Getting quotas for user 454c2bf24ed94f82b453df36e6e8eac1 and project 56d236fd14cd49168a3842369badc524. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:11:13.945375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:11:13.947742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:11:13.999529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b9be1d6e-ef88-488d-aa02-fecf9b893ffb tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.716651 Aug 17 20:11:14.000184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 359/703] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:11:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:11:14.011294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f5485362-db80-473c-806d-2663a4825c0a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:14.011936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f5485362-db80-473c-806d-2663a4825c0a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:14.067551 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f5485362-db80-473c-806d-2663a4825c0a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:14.074410 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f5485362-db80-473c-806d-2663a4825c0a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1239 microversion: 2.1 time: 0.067124 Aug 17 20:11:14.074973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 345/704] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:14 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:15.094532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:15.095132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:15.103226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:15.103796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:15.104224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:15.104911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:15.105349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:15.105835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:15.179868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:15.187624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e44b787b-e98f-4608-b3a5-21e92579af6a tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1299 microversion: 2.1 time: 0.097141 Aug 17 20:11:15.195233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 360/705] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:15 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:16.209118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:16.209759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:16.216866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:16.217345 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:16.217805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:16.218499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:16.218950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:16.219351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:16.348197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:16.356111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f73159f0-ef16-4fa2-8896-e043a485b574 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.151271 Aug 17 20:11:16.357063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 346/706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:16 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:16.531478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed07e8d-418a-4da5-afe7-a624bb8c849b", "tag": "13fdd4f9-3b88-461b-af40-c09b5db2d500"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:16.547076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:16.547578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:16.548006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:16.560314 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] Creating event network-changed:13fdd4f9-3b88-461b-af40-c09b5db2d500 for instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b on hv-cinder-82002 Aug 17 20:11:16.565251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-14f2e51a-d151-45e8-9962-0bdd9392560f req-fbfc9bbb-e904-4ef8-9722-ea452b850fcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037659 Aug 17 20:11:16.570612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 361/707] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:17.383324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:17.385145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:17.400221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:17.401055 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:17.401813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:17.402940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:17.403737 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:17.404412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:17.553808 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:17.563588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-60b3a01d-7d55-4f09-96cc-09353612d30d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.188506 Aug 17 20:11:17.564404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 347/708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:17 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:18.586399 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:18.587110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:18.593836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:18.594311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:18.594731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:18.595412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:18.595852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:18.596261 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:18.737493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:18.748809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b5d0818f-0092-45c7-9127-4dc32ab40eaa tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.167460 Aug 17 20:11:18.749686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 362/709] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:18 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:19.772371 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:19.772974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:19.780023 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:19.780508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:19.780942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:19.781643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:19.782096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:19.782516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:19.926906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:19.935846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d6f74372-f869-4d37-ae4f-1b6808891f73 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.167424 Aug 17 20:11:19.936415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:19 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:20.966441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:20.967297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:20.978257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:20.978732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:20.979185 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:20.979876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:20.980329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:20.980741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:21.123863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:21.131697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-edca7efc-271f-4d71-a944-8885ba1eb9ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.172058 Aug 17 20:11:21.132273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 363/711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:20 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:22.153711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:22.154313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:22.160871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:22.161346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:22.161786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:22.162467 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:22.162902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:22.163309 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:22.301786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:22.310220 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7117b007-26dd-48fa-83e8-08baf0d838c9 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.160862 Aug 17 20:11:22.310794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 349/712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:22 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:22.604151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed07e8d-418a-4da5-afe7-a624bb8c849b", "name": "network-vif-plugged", "status": "completed", "tag": "13fdd4f9-3b88-461b-af40-c09b5db2d500"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:22.614694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:22.615296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:22.615725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:22.627214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] Creating event network-vif-plugged:13fdd4f9-3b88-461b-af40-c09b5db2d500 for instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b on hv-cinder-82002 Aug 17 20:11:22.632101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-5f0d2f2c-3141-4c92-82bb-cebc009b5d4e req-e8b091d1-7db7-448b-a92a-eddbc3a7b79a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031724 Aug 17 20:11:22.632691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 364/713] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:23.335365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:23.336506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:23.347645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:23.348615 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:23.349331 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:23.350527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:23.351269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:23.351962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:23.495902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:23.503964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a0a7b15d-478e-4afe-b4f0-78f0d08ab131 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1364 microversion: 2.1 time: 0.175126 Aug 17 20:11:23.504539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 350/714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:23 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:24.524521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:24.525463 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:24.529793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:24.530551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:24.540450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:24.540949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:24.541393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:24.542256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:24.542765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:24.543198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:24.677149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:11:24.689880 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-883aef7d-c734-4e6b-98f9-bc327e823c85 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1553 microversion: 2.1 time: 0.167846 Aug 17 20:11:24.690722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 365/715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:11:24 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:11:24.710626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:11:24.711166 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:11:24.713077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:11:24.719193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:24.719661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:24.720088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:24.720801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:24.721242 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:24.721686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:24.805065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b118fed7-c9f8-4dc2-8ab1-d268db3898ec tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098320 Aug 17 20:11:24.806119 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 351/716] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 17 20:11:24 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:11:26.036489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed07e8d-418a-4da5-afe7-a624bb8c849b", "tag": "13fdd4f9-3b88-461b-af40-c09b5db2d500"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:11:26.046509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:11:26.046977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:11:26.047397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:11:26.058848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] Creating event network-changed:13fdd4f9-3b88-461b-af40-c09b5db2d500 for instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b on hv-cinder-82002 Aug 17 20:11:26.063872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-d0e1b620-23ae-490b-99ca-90e09c2d3f08 req-fccfd09d-c204-4003-bb09-7f32e269237c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031138 Aug 17 20:11:26.064455 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 366/717] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:03.794768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:03.795588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=43 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:03.800628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:03.801236 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:03.810820 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:03.811443 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:03.811936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:03.812827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:03.813439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:03.814143 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:03.840814 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d4aa35a9-0f86-4ffc-b2bb-2d253cfe404a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/ips" status: 200 len: 150 microversion: 2.20 time: 0.048481 Aug 17 20:12:03.841370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 352/718] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 17 20:12:03 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:12:06.292733 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:06.293971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:06.300739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:06.301802 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:06.311652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:06.312107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:06.312536 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:06.313222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:06.313697 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:06.314113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:06.337555 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lazy-loading 'flavor' on Instance uuid e40ce772-7f69-4c16-87d6-fa3ae625d7a4 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:12:06.561709 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b8cd9d4a-3c37-4557-8c98-1f58b99b3a0f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/action" status: 202 len: 0 microversion: 2.20 time: 0.271689 Aug 17 20:12:06.562394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 367/719] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 17 20:12:06 2022] POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:12:06.571052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:06.571698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:06.578033 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:06.578743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:06.579358 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:06.580051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:06.580517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:06.580942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:06.713908 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:06.722295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:06.723811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:06.724955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e1232f4b-5af1-4377-9ccf-78ddabf6314c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.157941 Aug 17 20:12:06.725528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 353/720] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:06 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:07.010445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:07.011397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:07.022270 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:07.023060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:07.023777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:07.024909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:07.025694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:07.026389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:07.052057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b6a376f4-08df-49f3-ae38-2fa374a860d2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/ips" status: 200 len: 147 microversion: 2.1 time: 0.048703 Aug 17 20:12:07.052632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 368/721] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:12:07 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:07.752785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:07.753849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:07.764643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:07.765431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:07.766188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:07.767298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:07.768032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:07.768720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:07.906502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:07.919499 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:07.921059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:07.922333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c6776541-ebbc-40d4-aa66-25bca8666b9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.176025 Aug 17 20:12:07.923147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 354/722] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:07 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:08.408170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c561a78-5400-44dc-94c9-fd967ecb5701"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:08.410521 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:08.417127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:08.417635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:08.418061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:08.418747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:08.419228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:08.419643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:08.715973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-22dffbd8-7a32-453e-a510-7ce3f7535bb9 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311509 Aug 17 20:12:08.716648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 369/723] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:12:08 2022] POST /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:08.950450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:08.951028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:08.957836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:08.958372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:08.958798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:08.959479 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:08.959921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:08.960346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:09.098618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:09.107144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:09.108630 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:09.109803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cfcf9458-6975-41f7-87b0-b315fe4e6e43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.163871 Aug 17 20:12:09.110357 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 355/724] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:08 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:10.138727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:10.139899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:10.150606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:10.151400 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:10.152155 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:10.153282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:10.154061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:10.154807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:10.296062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:10.304829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:10.306371 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:10.307519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fef04a3a-a011-406f-94e8-b7effada0512 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.176629 Aug 17 20:12:10.308102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 370/725] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:10 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:11.342052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:11.342912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:11.353991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:11.354783 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:11.355494 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:11.356638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:11.357372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:11.358224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:11.493162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:11.501562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:11.503096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:11.504246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ebdcd59-3028-4795-9b19-9d441c53126c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.168973 Aug 17 20:12:11.504813 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 356/726] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:11 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:12.527084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:12.527736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:12.534881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:12.535366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:12.535790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:12.536480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:12.536920 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:12.537328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:12.685479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:12.694034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:12.695539 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:12.696681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1b3a58c6-2089-42a4-883c-cc85087506fa tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.173656 Aug 17 20:12:12.697254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 371/727] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:12 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:13.723541 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:13.724481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:13.734535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:13.735251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:13.735917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:13.736940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:13.737609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:13.738283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:13.876438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:13.889341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:13.891634 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:13.893397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9075ab36-e1e6-41aa-81fc-9dae8c67d60f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.175585 Aug 17 20:12:13.894211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 357/728] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:13 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:14.924541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:14.925498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:14.936789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:14.937670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:14.938379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:14.939506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:14.940299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:14.940985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:15.081921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:15.090644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:15.092134 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:15.093292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c953a2e5-0627-4650-abca-f912f792598e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.175388 Aug 17 20:12:15.093898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 372/729] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:14 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:16.120469 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:16.121436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:16.129564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.130092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.130528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.131192 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.131668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.132087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.261918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:16.270259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:16.271743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:16.272884 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c18ee7b7-f003-4eb1-9f66-73d282f3f391 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.159009 Aug 17 20:12:16.273649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 358/730] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:16 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:16.291809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:16.294095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:16.300791 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.301236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.301693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.302377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.302820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.303239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.332651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-924c0994-cea3-4fc7-8fbd-1ec58d592526 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Aug 17 20:12:16.333195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 373/731] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:12:16 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:12:16.349917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:16.350661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:16.359583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.360032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.360464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.361141 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:16.361570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:16.362023 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:16.390341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e93c276a-8435-482c-8e57-bd7524bb5f0e tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701" status: 200 len: 194 microversion: 2.1 time: 0.046632 Aug 17 20:12:16.390834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 359/732] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 17 20:12:16 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:17.298940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:17.299687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:17.308912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:17.309656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:17.310165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:17.311109 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:17.311727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:17.312310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:17.451752 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:17.459797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:17.461300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:17.462482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a58f8bc4-01fb-492a-afd1-9acc3e770f65 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.169849 Aug 17 20:12:17.463076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 374/733] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:17 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:17.762862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16e5aba9-44cb-4d96-a989-67257403d307"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:17.765400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:17.772552 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:17.773042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:17.773474 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:17.774319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:17.774674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:17.775090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:18.067630 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dc06fb36-7471-44b8-9c45-cd4d8be47b3c tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "POST /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308645 Aug 17 20:12:18.068235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 360/734] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:12:17 2022] POST /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:18.485824 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:18.486366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:18.493593 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:18.494076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:18.494509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:18.495206 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:18.495656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:18.496078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:18.632384 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:18.641076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:18.642672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:18.643984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bf317742-127d-4fe7-8a47-f6f0d52dacac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.162408 Aug 17 20:12:18.644542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 375/735] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:18 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:19.672704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:19.673872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:19.685530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:19.686360 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:19.687063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:19.688189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:19.688916 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:19.689326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:19.836069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:19.847040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:19.848531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:19.849710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e10290a2-7e6a-4817-a883-54d06380deb4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.184259 Aug 17 20:12:19.850260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 361/736] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:19 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:20.876006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:20.876984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:20.887945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:20.888729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:20.889432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:20.890622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:20.891354 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:20.892017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:21.022326 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:21.030887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:21.032435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:21.033584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-03bb172b-0b05-408c-8371-62bfa1d2bfbe tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.164166 Aug 17 20:12:21.034145 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 376/737] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:20 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:22.060971 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:22.061955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:22.072714 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:22.073494 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:22.074246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:22.075374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:22.076104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:22.076786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:22.212776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:22.224193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:22.225717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:22.226848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ead83339-ce5d-49c8-a31c-81777d65d5dc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.172540 Aug 17 20:12:22.227403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 362/738] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:22 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:23.250198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:23.250795 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:23.257721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:23.258197 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:23.258623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:23.259312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:23.259755 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:23.260135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:23.393974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:23.405312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:23.406853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:23.408019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8303a0b9-dc72-461c-b3b5-261133d4fe5e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1743 microversion: 2.20 time: 0.161857 Aug 17 20:12:23.408699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 377/739] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:23 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:24.436615 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:24.437592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:24.446032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:24.446713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:24.447142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:24.447823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:24.448262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:24.448674 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:24.589734 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:24.600629 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:24.602152 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:24.603291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa9dfdb7-1bec-4271-9622-842b7f204cd6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1743 microversion: 2.20 time: 0.173594 Aug 17 20:12:24.603881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 363/740] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:24 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:25.628530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:25.629701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:25.637476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.638020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.638597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.639298 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.639743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.640366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.667598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:25.669850 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:25.676289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.676760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.677182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.677929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.678732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.679146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.709125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-43786b16-7a2d-4bb5-a41f-086044b75441 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045316 Aug 17 20:12:25.709767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 364/741] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:12:25 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:12:25.768878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:25.777307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:25.778850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:25.780013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c4632766-02b3-4f80-9229-9d9cfc92f125 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1743 microversion: 2.20 time: 0.156972 Aug 17 20:12:25.780562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 378/742] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:25 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:25.852937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:25.853429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:25.859860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.860338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.860773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.861456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.861935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.862351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.891290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-72f2dc1c-5f8f-440e-a296-3a3a48189578 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701" status: 200 len: 194 microversion: 2.1 time: 0.042468 Aug 17 20:12:25.891846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 365/743] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 17 20:12:25 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:25.905127 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:25.905891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:25.914482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.914986 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.915403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:25.916090 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:25.916564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:25.916962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:26.000854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lazy-loading 'services' on Instance uuid 2891ed34-b8f6-4ebf-b2a6-5b4089050186 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:12:26.068505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:26.090283 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-550c8ce2-f4ae-44a2-953e-67bcbe274b9b tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701" status: 202 len: 0 microversion: 2.1 time: 0.190895 Aug 17 20:12:26.091304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 379/744] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:12:25 2022] DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/3c561a78-5400-44dc-94c9-fd967ecb5701 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:12:26.803915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:26.804520 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:26.813071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:26.813503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:26.813944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:26.814641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:26.815122 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:26.815541 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:26.949176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:26.957165 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:26.958737 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:26.959929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-38858e20-55f3-4277-9cc9-41b0d3149305 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1743 microversion: 2.20 time: 0.160492 Aug 17 20:12:26.960536 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 366/745] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:26 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:27.989588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:27.990722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:27.998042 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:27.998517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:27.998946 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:27.999630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:28.000077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:28.000491 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:28.141955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:28.151923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:28.153430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:28.154601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-561fda93-510c-40af-afd6-3b2c3d9e31d6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1743 microversion: 2.20 time: 0.173800 Aug 17 20:12:28.155160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 380/746] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:27 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:28.284523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:28.285020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:28.291812 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:28.292283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:28.292710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:28.293390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:28.293854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:28.294262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:28.311083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:28.325366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-46fc1e1c-c2f1-44c2-aad7-85fdc3cef678 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/16e5aba9-44cb-4d96-a989-67257403d307" status: 200 len: 194 microversion: 2.1 time: 0.044813 Aug 17 20:12:28.326087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 367/747] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 17 20:12:28 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/16e5aba9-44cb-4d96-a989-67257403d307 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:28.342436 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:28.343084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:28.351995 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:28.352472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:28.352899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:28.353586 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:28.354063 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:28.354482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:28.447613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lazy-loading 'services' on Instance uuid 2891ed34-b8f6-4ebf-b2a6-5b4089050186 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:12:28.527160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1ccd9dd1-3450-4a11-9ddc-a5ef42907642 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/16e5aba9-44cb-4d96-a989-67257403d307" status: 202 len: 0 microversion: 2.1 time: 0.191206 Aug 17 20:12:28.527797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 381/748] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:12:28 2022] DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments/16e5aba9-44cb-4d96-a989-67257403d307 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:12:29.128071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "name": "network-vif-plugged", "status": "completed", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:29.138500 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.139336 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.139654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.158721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] Creating event network-vif-plugged:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:12:29.164822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-0dd525d7-ba66-40e6-a18a-72afaf71c04c req-5de3a64c-0e26-4e0e-acf7-3a61e0e7f279 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040005 Aug 17 20:12:29.164822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 368/749] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:29.182738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:29.183450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:29.190391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.191011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.191285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.192047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.192681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.194161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.338789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:29.347863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:29.349393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:29.350725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c2ce340e-65cb-47db-acb4-afa6d0ca42e8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.173592 Aug 17 20:12:29.351288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 382/750] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:29 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:29.711064 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:29.713228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:29.720310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.720830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.721218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.721942 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.722391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.722805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.752923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d6f27cdf-f16a-4cc7-b672-5e1b70c1197a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046671 Aug 17 20:12:29.753480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 369/751] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:12:29 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 20:12:29.874200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:29.876686 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:29.883475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.884358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.884897 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.885887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.886541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.887165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.921803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fb05ce8a-767c-4dd2-a7a1-99d3c35bb289 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051400 Aug 17 20:12:29.922387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 383/752] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:12:29 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:12:29.986611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:29.987081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:29.994302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.995412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.995852 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:29.996561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:29.997005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:29.997389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:30.023785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:12:30.107404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d13afb50-9b6a-4dff-8926-34c0329ff846 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 204 len: 0 microversion: 2.1 time: 0.124333 Aug 17 20:12:30.111752 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 370/753] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:12:29 2022] DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:12:30.129355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:30.130258 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:30.140643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:30.141186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:30.142165 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:30.142928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:30.143451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:30.143938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:30.311638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:30.322928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d3dd46a4-bf3e-4e20-a3ee-b78b5b5a9162 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1673 microversion: 2.1 time: 0.201082 Aug 17 20:12:30.323950 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 384/754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:30 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:12:30.374716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:30.375823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:30.384579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:30.384974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:30.385771 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:30.386554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:30.386990 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:30.387423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:30.534342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:30.548012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:30.550496 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:30.553044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6e56aeb5-75e9-41dd-9ed3-e2bae73c7332 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.182494 Aug 17 20:12:30.554425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 371/755] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:30 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:31.344703 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:31.345328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:31.354528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:31.355558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:31.356641 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:31.357712 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:31.358563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:31.359317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:31.513890 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:31.522911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4c68606d-7d3d-4380-9998-016236cac0b2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1673 microversion: 2.1 time: 0.182148 Aug 17 20:12:31.524144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 385/756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:31 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:12:31.576584 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:31.577201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:31.583959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:31.584573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:31.585258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:31.586198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:31.586708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:31.587317 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:31.730374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:31.739299 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:31.741289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:31.742797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b63e4beb-4488-4b99-b68b-3119693f4b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.170377 Aug 17 20:12:31.758254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 372/757] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:31 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:32.544473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:32.545795 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:32.552741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:32.553864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:32.554463 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:32.555340 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:32.555785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:32.556413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:32.742972 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:32.755818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-460db99b-823b-4e8d-8d88-1af203f353ea tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1673 microversion: 2.1 time: 0.215140 Aug 17 20:12:32.757415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 386/758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:32 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:12:32.766522 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:32.767401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:32.774592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:32.777412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:32.777978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:32.778790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:32.779342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:32.779880 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:32.945408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:32.956138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:32.957893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:32.959274 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-87b90017-e97c-4680-9043-54c10f5b4bcf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.196722 Aug 17 20:12:32.960239 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 373/759] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:32 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:33.624363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ed34-b8f6-4ebf-b2a6-5b4089050186", "name": "network-vif-deleted", "tag": "b4256248-9b5e-475a-bb4b-b0253e43b49e"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:33.665112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.666025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.666749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:33.687603 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] Creating event network-vif-deleted:b4256248-9b5e-475a-bb4b-b0253e43b49e for instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 on hv-cinder-82002 Aug 17 20:12:33.695316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-2b10d976-af6a-4997-964e-e9ec7add2a94 req-7d7271db-1ca1-4c94-a7ae-5dc263bbab1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076845 Aug 17 20:12:33.703002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 387/760] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:33.777453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:33.778140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:33.803066 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.805826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.807832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:33.809483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.814698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.816102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:33.883516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:33.885828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.886465 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.887096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:33.887739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lazy-loading 'fault' on Instance uuid 2891ed34-b8f6-4ebf-b2a6-5b4089050186 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:12:33.939840 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a40f55377b64f6f93784eefaf28152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5173bee1cf4ec09240370892c5b9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:33.947756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-265b315f-2cb3-48ff-a2a2-c5f90aa469a3 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 200 len: 1326 microversion: 2.1 time: 0.174325 Aug 17 20:12:33.948329 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 374/761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:33 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:12:33.983960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:33.984967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:33.991563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.992263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.992999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:33.993900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:33.994523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:33.995102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:34.182426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:34.210945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:34.212948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:34.219951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dee48896-4f96-4824-947d-1cb0401582e2 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.240356 Aug 17 20:12:34.220792 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 388/762] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:33 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:34.972119 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:34.972991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:34.980249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:34.980733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:34.981154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:34.981879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:34.982319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:34.983099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:35.004084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 HTTP/1.1 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:12:35.007749 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:35.009636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '2891ed34-b8f6-4ebf-b2a6-5b4089050186'} Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:35.010594 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:35.012094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:35.017174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:35.017174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dd09c2f6-d72b-438a-9085-ba5f01a20bd2 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 404 len: 111 microversion: 2.1 time: 0.045923 Aug 17 20:12:35.017174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 375/763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:34 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:35.024828 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1c2157dd-eb04-46b8-8f1c-13987e223de1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '.version_select at 0x7faaacabeee0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:35.051724 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1c2157dd-eb04-46b8-8f1c-13987e223de1 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570547384" status: 202 len: 0 microversion: 2.1 time: 0.032982 Aug 17 20:12:35.052663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 389/764] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 17 20:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570547384 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:12:35.248106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:35.248567 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:35.255919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:35.255919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:35.256330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:35.256687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:35.257468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:35.257919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:35.488843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:35.498412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:35.500408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:35.501945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf6ebe70-a8d6-46b6-b23e-46de02390847 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.257734 Aug 17 20:12:35.502815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 376/765] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:35 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:36.525267 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:36.526531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:36.528643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:36.537923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:36.538488 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:36.538924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:36.539826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:36.540325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:36.540771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:36.692204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:36.701393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:36.703309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:36.704687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9b686368-0b9e-4932-92ad-0ee129021685 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.184345 Aug 17 20:12:36.705571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 390/766] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:36 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:37.728747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:37.730183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:37.736788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:37.737680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:37.738298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:37.739265 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:37.739860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:37.740320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:37.892121 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:37.900640 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:37.902175 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:37.903304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ec93cb91-e4f1-4e89-a386-02e0038a143c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.178928 Aug 17 20:12:37.904075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 377/767] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:37 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:38.219357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:38.220464 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:38.239441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.242626 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.243316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:38.244209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.245016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.245887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:38.267368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 HTTP/1.1 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:12:38.269347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.270947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '2891ed34-b8f6-4ebf-b2a6-5b4089050186'} Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:38.272064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.274083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.281685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:38.288416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d6ec7e0b-5b39-49a9-88a8-e718f8494542 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 404 len: 111 microversion: 2.1 time: 0.074834 Aug 17 20:12:38.289321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 391/768] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:12:38 2022] DELETE /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:38.297315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:38.298681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 2891ed34-b8f6-4ebf-b2a6-5b4089050186] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:38.307048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.307865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.308383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:38.309166 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.309931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.310620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:38.328848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 HTTP/1.1 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:12:38.331096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.332785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '2891ed34-b8f6-4ebf-b2a6-5b4089050186'} Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:38.333748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. Aug 17 20:12:38.335320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:38.338230 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 2891ed34-b8f6-4ebf-b2a6-5b4089050186 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:38.339314 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-34b493dc-1d93-48e3-9dcd-f4e3ac719d3a tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186" status: 404 len: 111 microversion: 2.1 time: 0.046097 Aug 17 20:12:38.339873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 378/769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:38 2022] GET /compute/v2.1/servers/2891ed34-b8f6-4ebf-b2a6-5b4089050186 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:38.929284 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:38.930144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:38.936523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.936998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.937424 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:38.938135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:38.938579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:38.938991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:39.078617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:39.087108 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:39.088596 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:39.089768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e2e94855-c5c8-4be5-99a3-32ceabc45bd9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1738 microversion: 2.20 time: 0.166086 Aug 17 20:12:39.090449 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 392/770] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:38 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:39.507151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:39.507704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:39.514762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:39.515234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:39.515682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:39.516335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:39.516779 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:39.517194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:39.530882 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 HTTP/1.1 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:12:39.532403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.533927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '32fcce73-27be-4ef7-a694-4e85c4d9ca67'} Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:39.534748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.535943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.537301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:39.537301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-53bc2670-9405-465d-a667-2a51b823a620 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 404 len: 111 microversion: 2.1 time: 0.032775 Aug 17 20:12:39.537301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 379/771] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:12:39 2022] DELETE /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:39.542665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:39.543253 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] [instance: 32fcce73-27be-4ef7-a694-4e85c4d9ca67] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:39.550153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:39.550628 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:39.551054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:39.551738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:39.552178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:39.552592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:39.566402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] HTTP exception thrown: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Request method failure captured: Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 HTTP/1.1 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Ul2QEyF2Uhxzvb06se72ezNb0piw5OZhveFaIgRi81u6lY-9oUGsH7_MqXidXZTt_daKfM63Odq4BR_-JNTJ39JwyFnLyx20_AFelm6Hha57dfEk0rlqi5zmG52thWOi1trd06xyyCRuKAGlBlmZwyUZicwFPdY77_xVf7_6MFVUTs Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:12:39.567932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/da5173bee1cf4ec09240370892c5b9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: da5173bee1cf4ec09240370892c5b9e3 Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2102678161 Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 3a40f55377b64f6f93784eefaf28152e Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeTestJSON-2102678161-project Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.569232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '32fcce73-27be-4ef7-a694-4e85c4d9ca67'} Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:39.570023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. Aug 17 20:12:39.571651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:39.573460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] Returning 404 to user: Instance 32fcce73-27be-4ef7-a694-4e85c4d9ca67 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:39.573460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-57927179-2407-4136-8d26-3ecb5bc3ff91 tempest-AttachVolumeTestJSON-2102678161 tempest-AttachVolumeTestJSON-2102678161-project] 10.222.0.18 "GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 17 20:12:39.573460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 393/772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:12:39 2022] GET /compute/v2.1/servers/32fcce73-27be-4ef7-a694-4e85c4d9ca67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:40.112572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:40.113180 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:40.119623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:40.120107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:40.120536 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:40.121238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:40.121717 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:40.122136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:40.257250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:40.265581 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:40.267090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:40.268282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5b43718e-26f5-4abe-84ea-5035693911a0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1720 microversion: 2.20 time: 0.159669 Aug 17 20:12:40.268817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 380/773] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:40 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:41.293727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:41.294967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:41.304015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:41.305457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:41.306652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:41.307830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:41.308565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:41.309287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:41.451022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:41.459114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:41.460611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:41.461809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-486f2bf7-e62c-424c-a556-a3cd28cbed60 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1720 microversion: 2.20 time: 0.173409 Aug 17 20:12:41.462361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 394/774] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:41 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:42.484604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:42.485183 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:42.492049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:42.492566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:42.492989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:42.493865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:42.494318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:42.494732 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:42.640827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:42.650074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:42.651661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:42.652927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-32285af6-4ca4-4268-ad5c-06828e19cedd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1720 microversion: 2.20 time: 0.172361 Aug 17 20:12:42.653609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 381/775] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:42 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:43.277311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "name": "network-vif-unplugged", "status": "completed", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:43.296410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:43.297483 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:43.298103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:43.312981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.compute.server_external_events [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] Unable to find a host for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4. Dropping event network-vif-unplugged {{(pid=120819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 20:12:43.314486 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-4ffcca50-8a79-435c-a23c-4a749c633500 req-eb8e1b6b-d248-465b-9d96-5f176213b775 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041169 Aug 17 20:12:43.315756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 395/776] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 20:12:43.676420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:43.677062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:43.685017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:43.685502 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:43.685962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:43.686667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:43.687207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:43.687628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:43.828597 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:43.836810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:43.838367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:43.839516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-64582a2a-9b85-48a8-b1af-f6eb28a0fbe8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1663 microversion: 2.20 time: 0.167104 Aug 17 20:12:43.840107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 382/777] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:43 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:43.864401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b116a354-5ee5-4982-b74c-c09d78b86ea1"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:43.866825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:43.873062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:43.873625 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:43.873993 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:43.874730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:43.875176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:43.875594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:44.175372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:44.184112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b764158b-6fc1-49f4-87b8-8db32d974d5b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324559 Aug 17 20:12:44.184756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 396/778] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 17 20:12:43 2022] POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:12:44.311153 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:44.311811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:44.317823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:44.318289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:44.318709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:44.319387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:44.319821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:44.320289 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:44.363110 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120818) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:12:44.424117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:44.440463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-58c3dda6-eeba-43b4-882b-f5174c902030 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/action" status: 202 len: 0 microversion: 2.20 time: 0.133213 Aug 17 20:12:44.441226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 383/779] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 17 20:12:44 2022] POST /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:12:44.449777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:44.450444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:44.458647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:44.459191 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:44.459626 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:44.460359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:44.460837 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:44.461257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:44.610290 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:44.623372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:44.625745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:44.631043 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f6ba2e1a-fae5-4b76-84ef-7bd60998d7a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1749 microversion: 2.20 time: 0.185696 Aug 17 20:12:44.631620 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 397/780] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:44 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:44.943105 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8dd80d56-5eaf-4a7b-8275-8dc38c4a82e4 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Action: 'create', calling method: .version_select at 0x7faaacae2c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1577120449"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:45.250859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8dd80d56-5eaf-4a7b-8275-8dc38c4a82e4 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.423273 Aug 17 20:12:45.251473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 384/781] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Aug 17 20:12:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 20:12:45.264002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6ca06467-be3a-4823-a4f6-1094f149c63e tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaad352ca0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:45.318392 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6ca06467-be3a-4823-a4f6-1094f149c63e tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 200 len: 345 microversion: 2.1 time: 0.058078 Aug 17 20:12:45.319053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 398/782] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:12:45 2022] GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:45.653958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:45.654559 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:45.661342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:45.661908 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:45.662333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:45.663013 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:45.663451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:45.663865 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:45.807079 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:45.816897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:45.818424 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:45.819578 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ab527c14-e166-4d8a-9e37-eceaabb1911d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1749 microversion: 2.20 time: 0.169680 Aug 17 20:12:45.820162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 385/783] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:45 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:46.336973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-435d29f3-5c4c-46ed-abc4-a3dd6724e62f tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca9eee0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:46.515462 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-435d29f3-5c4c-46ed-abc4-a3dd6724e62f tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 200 len: 346 microversion: 2.1 time: 0.186014 Aug 17 20:12:46.516024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 399/784] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:12:46 2022] GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:46.529054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5b2edbc4-1a89-4f46-9989-1a4cd9fd13af tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Action: 'create', calling method: .version_select at 0x7faaace55a60>, body: {"snapshot": {"volume_id": "1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1648844015"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:46.694762 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5b2edbc4-1a89-4f46-9989-1a4cd9fd13af tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.169944 Aug 17 20:12:46.695342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 386/785] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Aug 17 20:12:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:46.706172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-323a3b57-d1ee-4752-a7f1-1176d5bb3c38 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca8e5e0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:46.743067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-323a3b57-d1ee-4752-a7f1-1176d5bb3c38 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.040664 Aug 17 20:12:46.744079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 400/786] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:46 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:46.754955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b3e47a3a-dc39-4a8a-8386-62f8bc1e191b tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaacb2a430>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:46.786089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b3e47a3a-dc39-4a8a-8386-62f8bc1e191b tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034859 Aug 17 20:12:46.787129 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 387/787] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 17 20:12:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:46.799958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0a46521-2fd9-464a-aebe-4760316172a0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaacace160>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:46.829869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d0a46521-2fd9-464a-aebe-4760316172a0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.033851 Aug 17 20:12:46.830497 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 401/788] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:46 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:46.842690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:46.843296 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:46.849379 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:46.849893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:46.850380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:46.851007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:46.851452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:46.851868 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:47.038470 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:47.047797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:47.049290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:47.050529 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-622c983c-4f08-4635-96e6-b9233b159f71 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.211706 Aug 17 20:12:47.051330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 388/789] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:46 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:47.847377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-75d3c46d-5184-4a9c-a2b2-31541c8d16b6 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaad317310>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:47.884756 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-75d3c46d-5184-4a9c-a2b2-31541c8d16b6 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.044386 Aug 17 20:12:47.885468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 402/790] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:47 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:48.074433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:48.075037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:48.081980 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:48.082451 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:48.082876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:48.083550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:48.083998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:48.084496 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:48.216690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:48.225248 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:48.226767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:48.227906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b0151d2-eb70-41c5-8a41-d0e56dae0c43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.157471 Aug 17 20:12:48.228459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 389/791] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:48 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:48.902876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f5c107ee-6768-4981-b0c5-8e531c47ac02 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca7e670>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:48.939828 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f5c107ee-6768-4981-b0c5-8e531c47ac02 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.044531 Aug 17 20:12:48.940394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 403/792] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:48 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:49.251402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:49.252006 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:49.259138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:49.259626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:49.260215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:49.260960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:49.261408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:49.261863 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:49.398691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:49.407653 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:49.409157 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:49.410344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0d5476e7-7a7c-4d1f-a74e-4e7267992056 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.163056 Aug 17 20:12:49.410880 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 390/793] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:49 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:49.953297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7c9326de-f678-4616-b50e-50bfe7f5a9f1 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaacac93a0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:49.982869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7c9326de-f678-4616-b50e-50bfe7f5a9f1 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.034040 Aug 17 20:12:49.983444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 404/794] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:49 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:50.437826 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:50.438798 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:50.449143 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:50.449659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:50.450076 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:50.450759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:50.451203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:50.451612 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:50.582585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:50.591704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:50.593204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:50.594402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-61bb4e26-ab52-4da4-a49b-95eb41599c79 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.163053 Aug 17 20:12:50.595232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 391/795] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:50 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:50.996000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2958df5c-4a1a-47ee-a73e-59f3e958b066 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca7e040>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:51.025949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2958df5c-4a1a-47ee-a73e-59f3e958b066 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.034204 Aug 17 20:12:51.026659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 405/796] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:50 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:51.621764 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:51.622943 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:51.639435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:51.640029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:51.640478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:51.641387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:51.642035 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:51.642454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:51.842702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:51.851505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:51.852997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:51.854706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb281b5a-1487-44a2-b26a-79035d1653c4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.239296 Aug 17 20:12:51.870090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 392/797] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:51 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:52.038695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7d62847a-f01f-4184-8030-38e5e561873e tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca84b80>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:52.069563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7d62847a-f01f-4184-8030-38e5e561873e tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 288 microversion: 2.1 time: 0.035252 Aug 17 20:12:52.070157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 406/798] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:52 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:52.081402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2719bf56-36f7-4f42-9c23-342fe740533a tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca931f0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:52.151338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2719bf56-36f7-4f42-9c23-342fe740533a tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 202 len: 0 microversion: 2.1 time: 0.073663 Aug 17 20:12:52.151905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 393/799] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Aug 17 20:12:52 2022] DELETE /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:12:52.160626 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0afe062e-2e7f-4930-bfae-499d665d6521 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca848b0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:52.193153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0afe062e-2e7f-4930-bfae-499d665d6521 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 200 len: 287 microversion: 2.1 time: 0.036771 Aug 17 20:12:52.194154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 407/800] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:52 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:52.810961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:52.811658 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:52.818912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:52.819396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:52.819994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:52.820869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:52.821317 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:52.821757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:52.853107 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0c9cc62c-e635-4ab3-898d-e03921cffdff tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/ips" status: 200 len: 149 microversion: 2.1 time: 0.047047 Aug 17 20:12:52.853699 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 394/801] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:12:52 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:52.878499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:52.879301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:52.886130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:52.891434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:52.891884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:52.892594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:52.893114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:52.893565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:53.056917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:53.066014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:53.067507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:53.068679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-91e52b6c-c274-495d-bc00-255f1a9113c7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.194327 Aug 17 20:12:53.069236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 408/802] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:52 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:53.205788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-445077ae-2968-41f7-91b6-ec212b0b46c2 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca933a0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:53.237552 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-445077ae-2968-41f7-91b6-ec212b0b46c2 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] HTTP exception thrown: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-445077ae-2968-41f7-91b6-ec212b0b46c2 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Request method failure captured: Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf HTTP/1.1 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uu8HZnTZRcBzUqO2BZLNHbz76o60gV9Pv4TgDo15nAwFZUnX3t9Ybi-XxriGhjNfT3UrJnH3Y60h6qOjAF95o5MBuMJ8hcgdUxgUEFRnEjyjsGec4MOZcFSP7cXSnLWnkgwgb-1uhC9hk3M8QjY9owVvvgmGtTITTEvU7j-4kTOQ-w Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:12:53.240946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3034511ba1cc438498ececa7de891f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3034511ba1cc438498ececa7de891f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 1fdb83232f6542ce8c39014575792177 Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '493caa78-90fb-45b4-bb94-622833fbd9bf'} Aug 17 20:12:53.242542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. (HTTP 404) (Request-ID: req-e461aaca-9760-4b0b-a127-409b7b830d7a) Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.243468 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:53.245073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 20:12:53.246571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. Aug 17 20:12:53.248310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:12:53.249988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-445077ae-2968-41f7-91b6-ec212b0b46c2 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Returning 404 to user: Snapshot 493caa78-90fb-45b4-bb94-622833fbd9bf could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:53.251075 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-445077ae-2968-41f7-91b6-ec212b0b46c2 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf" status: 404 len: 111 microversion: 2.1 time: 0.049323 Aug 17 20:12:53.255318 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 395/803] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:12:53 2022] GET /compute/v2.1/os-snapshots/493caa78-90fb-45b4-bb94-622833fbd9bf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:53.260794 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4fe17273-fe47-4c10-bfc8-33f131977ea8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaad4ddc10>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:53.329719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4fe17273-fe47-4c10-bfc8-33f131977ea8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 202 len: 0 microversion: 2.1 time: 0.073108 Aug 17 20:12:53.333557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 409/804] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:12:53 2022] DELETE /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:12:53.338685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f5cf85dd-291a-4ead-aab0-13feae32d2af tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaacb139d0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:53.392527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f5cf85dd-291a-4ead-aab0-13feae32d2af tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 200 len: 345 microversion: 2.1 time: 0.057610 Aug 17 20:12:53.393131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 396/805] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:12:53 2022] GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:12:54.094680 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:54.094680 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:54.108511 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:54.109402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:54.110793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:54.112365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:54.112931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:54.113416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:54.256363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:54.276666 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:54.278357 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:54.279801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a969714c-f44e-4956-8382-b571017e5281 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.191024 Aug 17 20:12:54.280694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 410/806] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:54 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:54.288828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5368a9d-cbe3-4014-9bdd-5d524df5a592"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:12:54.291338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:54.299370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:54.300614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:54.301138 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:54.302068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:54.302723 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:54.303146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:54.406741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fcb997c8-3504-4c10-bfe6-d370759947e0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaaca7edc0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:54.436155 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-fcb997c8-3504-4c10-bfe6-d370759947e0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] HTTP exception thrown: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fcb997c8-3504-4c10-bfe6-d370759947e0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Request method failure captured: Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e HTTP/1.1 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uu8HZnTZRcBzUqO2BZLNHbz76o60gV9Pv4TgDo15nAwFZUnX3t9Ybi-XxriGhjNfT3UrJnH3Y60h6qOjAF95o5MBuMJ8hcgdUxgUEFRnEjyjsGec4MOZcFSP7cXSnLWnkgwgb-1uhC9hk3M8QjY9owVvvgmGtTITTEvU7j-4kTOQ-w Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:12:54.438186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3034511ba1cc438498ececa7de891f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3034511ba1cc438498ececa7de891f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1fdb83232f6542ce8c39014575792177 Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e'} Aug 17 20:12:54.439508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. (HTTP 404) (Request-ID: req-3fccefbf-8da9-4605-9599-d27d77ff15b8) Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.440307 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:54.441714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:12:54.442883 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fcb997c8-3504-4c10-bfe6-d370759947e0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Returning 404 to user: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fcb997c8-3504-4c10-bfe6-d370759947e0 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 404 len: 109 microversion: 2.1 time: 0.036710 Aug 17 20:12:54.444372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 411/807] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:12:54 2022] GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:12:54.455239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0a250c74-57f8-4ace-89a2-f1aaffc7d2e8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaad352af0>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:54.485236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-0a250c74-57f8-4ace-89a2-f1aaffc7d2e8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] HTTP exception thrown: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0a250c74-57f8-4ace-89a2-f1aaffc7d2e8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Request method failure captured: Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e HTTP/1.1 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uu8HZnTZRcBzUqO2BZLNHbz76o60gV9Pv4TgDo15nAwFZUnX3t9Ybi-XxriGhjNfT3UrJnH3Y60h6qOjAF95o5MBuMJ8hcgdUxgUEFRnEjyjsGec4MOZcFSP7cXSnLWnkgwgb-1uhC9hk3M8QjY9owVvvgmGtTITTEvU7j-4kTOQ-w Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:12:54.487273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3034511ba1cc438498ececa7de891f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3034511ba1cc438498ececa7de891f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1fdb83232f6542ce8c39014575792177 Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e'} Aug 17 20:12:54.488556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. (HTTP 404) (Request-ID: req-98443bd1-49cc-424b-ac1b-167349029227) Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.489481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:12:54.490841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:12:54.492667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0a250c74-57f8-4ace-89a2-f1aaffc7d2e8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Returning 404 to user: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0a250c74-57f8-4ace-89a2-f1aaffc7d2e8 tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 404 len: 109 microversion: 2.1 time: 0.038243 Aug 17 20:12:54.494903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 412/808] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 17 20:12:54 2022] DELETE /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:12:54.499275 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1169aed4-6c53-47a4-9081-4a941bb989ff tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Calling method '.version_select at 0x7faaacac9a60>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:54.530921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-1169aed4-6c53-47a4-9081-4a941bb989ff tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] HTTP exception thrown: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1169aed4-6c53-47a4-9081-4a941bb989ff tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Request method failure captured: Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e HTTP/1.1 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uu8HZnTZRcBzUqO2BZLNHbz76o60gV9Pv4TgDo15nAwFZUnX3t9Ybi-XxriGhjNfT3UrJnH3Y60h6qOjAF95o5MBuMJ8hcgdUxgUEFRnEjyjsGec4MOZcFSP7cXSnLWnkgwgb-1uhC9hk3M8QjY9owVvvgmGtTITTEvU7j-4kTOQ-w Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:12:54.533119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3034511ba1cc438498ececa7de891f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3034511ba1cc438498ececa7de891f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3034511ba1cc438498ececa7de891f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 3034511ba1cc438498ececa7de891f50 Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1010648516 Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1fdb83232f6542ce8c39014575792177 Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1010648516-project Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e'} Aug 17 20:12:54.534485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. (HTTP 404) (Request-ID: req-7f4c5538-d6ed-45b4-ae74-7dc7d8e99fce) Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.535297 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:12:54.536732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:12:54.538204 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1169aed4-6c53-47a4-9081-4a941bb989ff tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] Returning 404 to user: Volume 1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1169aed4-6c53-47a4-9081-4a941bb989ff tempest-VolumesSnapshotsTestJSON-1010648516 tempest-VolumesSnapshotsTestJSON-1010648516-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e" status: 404 len: 109 microversion: 2.1 time: 0.040048 Aug 17 20:12:54.539673 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 413/809] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 17 20:12:54 2022] GET /compute/v2.1/os-volumes/1d0eb194-8fbb-4af3-a01a-c2f91bad6e6e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:12:55.314144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:55.316899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:55.323799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:55.324336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:55.324796 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:55.325581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:55.326182 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:55.326660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:55.478634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:55.489266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:55.490831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:55.491999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-65febc80-79fb-4f6d-9884-33659dfc0367 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.191826 Aug 17 20:12:55.492560 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 414/810] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:55 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:12:56.515317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:56.516019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:56.522924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:56.523645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:56.524152 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:56.525093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:56.526545 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:56.527057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:56.682086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:56.691989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:56.694184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:56.696087 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-12459951-99ca-4ff7-86fe-cf13873c895f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.184753 Aug 17 20:12:56.697515 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 415/811] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:56 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:12:57.722596 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:57.723377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:57.743319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:57.743826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:57.744264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:57.745022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:57.745476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:57.745922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:57.920289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:57.930255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:57.931845 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:57.933144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bad763fa-db3b-4834-8348-e1acd08d544f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.214567 Aug 17 20:12:57.933730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 416/812] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:57 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:12:58.956607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:58.957301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:12:58.963656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:58.964134 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:58.964568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:58.965282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:58.965827 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:58.966281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:59.143954 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:59.162935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:59.164868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:12:59.166534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-27fdd016-fee3-46b3-a03b-26bd4dab5b2d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.214016 Aug 17 20:12:59.167919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 417/813] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:12:58 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:00.189507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:00.190223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:00.197228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:00.197751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:00.198247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:00.198950 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:00.199394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:00.199974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:00.363594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:00.373186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:00.374712 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:00.375885 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-119fe6ca-2c3b-466b-98e3-7e5ca91e9e4a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.190284 Aug 17 20:13:00.376761 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 418/814] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:00 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:01.402050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:01.403082 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:01.410329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:01.410901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:01.411241 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:01.411935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:01.412382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:01.412801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:01.559407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:01.568207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:01.569728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:01.570857 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2d9c3b14-dee8-498e-803f-6be1a31ab621 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.174940 Aug 17 20:13:01.571415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 419/815] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:01 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:13:02.596862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:02.597561 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:02.607848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:02.608534 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:02.609136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:02.610207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:02.610782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:02.611375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:02.751069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:02.760178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:02.761692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:02.762834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e878adbe-dd6d-4fed-8509-a0a37e34ab4d tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.171993 Aug 17 20:13:02.763361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 420/816] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:02 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:03.790132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:03.791168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:03.798739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:03.799221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:03.799650 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:03.800345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:03.800798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:03.801219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:03.937753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:03.950158 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:03.951660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:03.952817 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c303ddcf-777b-447e-a143-e2c5bfa55db6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.169474 Aug 17 20:13:03.953383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 421/817] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:03 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:04.299003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:04.396421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=46 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:04.980222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:04.981454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:04.992198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:04.992964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:04.993720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:04.994848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:04.995587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:04.996270 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:05.135368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:05.145665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:05.147170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:05.148331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0da2d14d-1384-41ef-ad12-e07559440bef tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.174778 Aug 17 20:13:05.148887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 422/818] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:04 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:06.174478 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:06.175322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:06.183414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:06.183977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:06.184479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:06.185295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:06.185866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:06.186422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:06.328908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:06.341893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:06.343605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:06.344765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9d829e65-3725-4322-9cb4-5c29aa6e2d6c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.175650 Aug 17 20:13:06.345327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 423/819] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:06 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:07.372046 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:07.373201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:07.378479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=40 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:07.384175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:07.384992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:07.385752 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:07.386884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:07.387622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:07.388320 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:07.734633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:07.743184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:07.744961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:07.746166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-cb5ab056-cb2d-418e-b628-8c35f6e8d114 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.380738 Aug 17 20:13:07.746731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 424/820] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:07 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:08.541721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad722705-783d-411e-8bc0-29f326e07b5e tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "POST /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.253464 Aug 17 20:13:08.541721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 397/821] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:12:54 2022] POST /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments => generated 194 bytes in 14255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:08.773691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:08.774570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:08.784505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:08.785094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:08.785704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:08.787541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:08.787541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:08.787806 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:08.926542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:08.936776 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:08.938403 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:08.939832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-68fb57b6-7c85-45ea-b3dd-c2b24cc04096 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.172716 Aug 17 20:13:08.940397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 425/822] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:08 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:09.968511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:09.969226 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:09.976681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:09.977155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:09.977579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:09.978285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:09.978722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:09.979134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:10.122825 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:10.131895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:10.133367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:10.134565 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf922fc9-2c4b-49fa-a0a4-038d45ad57f1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.173897 Aug 17 20:13:10.135116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 398/823] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:09 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:11.166351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:11.166938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:11.173702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:11.174323 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:11.175047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:11.175873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:11.176377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:11.176861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:11.308803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:11.317992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:11.319514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:11.321985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7040b7ce-d34a-4654-9780-e03da21e45c5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.159675 Aug 17 20:13:11.322757 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 426/824] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:11 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:12.345057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:12.345800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:12.353348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:12.354077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:12.354501 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:12.355344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:12.356099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:12.356777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:12.493130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:12.503327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:12.504801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:12.505975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-276f3bf2-56e0-46eb-a14c-a2fcbca17ccf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.164948 Aug 17 20:13:12.506575 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 399/825] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:12 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:13.533352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:13.534023 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:13.541258 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:13.542033 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:13.542461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:13.543144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:13.543585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:13.543998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:13.563044 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=100 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:13.673444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:13.683334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:13.685160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:13.686380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-33a5c6ba-7084-42d0-9e63-f6a001974d83 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.160512 Aug 17 20:13:13.686935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 427/826] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:13 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:14.710125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:14.710730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:14.718476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:14.719135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:14.719598 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:14.720308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:14.720754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:14.721187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:14.866556 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:14.874955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:14.876442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:14.877603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-156473f2-c98a-4256-b8e0-810b561ad047 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.171739 Aug 17 20:13:14.878171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 400/827] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:14 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:15.900234 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:15.900839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:15.907358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:15.907832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:15.908256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:15.908941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:15.909385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:15.909829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:16.054064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:16.062543 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:16.064144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:16.066070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f4242ea8-b3a1-4891-a62a-20da82de2eeb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.169686 Aug 17 20:13:16.066747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 428/828] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:15 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:16.212232 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:16.212735 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:16.219589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:16.220067 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:16.220464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:16.221151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:16.221636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:16.222056 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:16.305309 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'services' on Instance uuid 5ed07e8d-418a-4da5-afe7-a624bb8c849b {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:13:16.379123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-045b37d6-073e-410e-9b06-7bc8d98de769 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments/a5368a9d-cbe3-4014-9bdd-5d524df5a592" status: 202 len: 0 microversion: 2.1 time: 0.171416 Aug 17 20:13:16.379716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 401/829] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:13:16 2022] DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments/a5368a9d-cbe3-4014-9bdd-5d524df5a592 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:13:16.388358 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:16.390625 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:16.397442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:16.397982 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:16.398589 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:16.399285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:16.399763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:16.400252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:16.431128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5bef0174-8052-4c6d-a082-ef5e5b982336 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046687 Aug 17 20:13:16.431687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 429/830] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:13:16 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:17.089254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:17.089967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:17.096472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.096949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.097374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.098091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.098535 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.098947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.274449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:17.287722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:17.289205 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:17.290395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d67d6669-6315-4f5c-bd7f-aeee14f7a5a5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.205678 Aug 17 20:13:17.291441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 402/831] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:17 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:17.443700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:17.446175 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:17.452937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.453417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.453898 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.454568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.455020 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.455440 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.484511 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9fda7773-2f3a-4baa-aed6-f34aeb79f98f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044795 Aug 17 20:13:17.485086 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 430/832] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:13:17 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:13:17.548729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:17.549221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:17.555577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.556054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.556505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.557302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.557875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.558295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.587161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:13:17.666931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eee7577b-b6c0-4573-85db-ec27ad1f1b16 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 204 len: 0 microversion: 2.1 time: 0.121676 Aug 17 20:13:17.667539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 403/833] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:13:17 2022] DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:13:17.676438 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:17.677321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:17.683862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.684343 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.684774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.685471 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:17.685955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:17.686375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:17.823981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:17.833739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-723a37ec-3a14-40ea-a539-cd923dfe3c17 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1678 microversion: 2.1 time: 0.160995 Aug 17 20:13:17.834477 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 431/834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:17 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:13:18.314962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:18.315685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:18.322242 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:18.322708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:18.323141 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:18.323835 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:18.324279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:18.324695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:18.517313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:18.526347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:18.527954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:18.529216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1bc1dd1a-4b20-4ffc-9069-e3aa1bfb3162 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.218891 Aug 17 20:13:18.529803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 404/835] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:18 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:18.855412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:18.856125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:18.862707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:18.863184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:18.863633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:18.864319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:18.864765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:18.865177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:19.003972 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:19.011745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8dce78cb-33e6-4f9b-b974-c4e2efbf132f tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1678 microversion: 2.1 time: 0.160254 Aug 17 20:13:19.012327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 432/836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:18 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:19.315387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "name": "network-vif-plugged", "status": "completed", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:19.330758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:19.331370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:19.331861 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:19.343454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] Creating event network-vif-plugged:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:13:19.348231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-f8c687d7-2893-4787-bfbc-1e53d8bffd34 req-892e0032-2e70-4fea-be91-ac60744f18ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036878 Aug 17 20:13:19.349000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 405/837] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:19.554159 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:19.554949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:19.561458 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:19.562069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:19.562621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:19.563393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:19.563928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:19.564416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:19.701300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:19.711638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:19.713156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:19.714348 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-006b9196-5c47-4b9a-af02-aef123f7bfff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.164560 Aug 17 20:13:19.714908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 433/838] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:19 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:20.033441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:20.034040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:20.040663 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:20.041133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:20.041600 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:20.042340 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:20.042803 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:20.043225 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:20.185341 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:20.194098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3ea9f94f-a0bc-4e86-8af8-77c33379fcc4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1678 microversion: 2.1 time: 0.165107 Aug 17 20:13:20.194836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 406/839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:20 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:20.738998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:20.739657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:20.746359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:20.746844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:20.747251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:20.747939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:20.748377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:20.748788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:20.889567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:20.902815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:20.906750 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:20.915572 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-18b5e4d8-baeb-4409-a2e3-51b212821eff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.180507 Aug 17 20:13:20.917172 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 434/840] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:20 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:20.929597 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed07e8d-418a-4da5-afe7-a624bb8c849b", "name": "network-vif-deleted", "tag": "13fdd4f9-3b88-461b-af40-c09b5db2d500"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:20.945203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:20.945773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:20.946424 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:20.961011 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] Creating event network-vif-deleted:13fdd4f9-3b88-461b-af40-c09b5db2d500 for instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b on hv-cinder-82002 Aug 17 20:13:20.966768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-4fbfa039-3d54-4fe4-a729-e379bea1520e req-ca078313-7d1f-4299-9e38-5478bbb09567 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047970 Aug 17 20:13:20.967644 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 407/841] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:13:21.215080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:21.216195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:21.223070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:21.223960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:21.224601 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:21.225568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:21.226344 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:21.226967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:21.295161 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:21.303008 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-409a74d1-3d13-49cc-bafa-7538f7cd4fa2 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1324 microversion: 2.1 time: 0.091889 Aug 17 20:13:21.305579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 435/842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:21 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1324 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:21.939625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:21.940400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:21.947949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:21.948438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:21.948869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:21.949577 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:21.950113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:21.950527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:22.110483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:22.121866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:22.123351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:22.124509 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5ec45594-7ee6-4314-a89f-7a1f51fcaa92 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1807 microversion: 2.20 time: 0.189650 Aug 17 20:13:22.125249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 408/843] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:21 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:22.325031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:22.325490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:22.331858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:22.332337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:22.332753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:22.333792 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:22.334014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:22.334401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:22.366908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:22.367388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:22.367823 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:22.368306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lazy-loading 'fault' on Instance uuid 5ed07e8d-418a-4da5-afe7-a624bb8c849b {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:13:22.417687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454c2bf24ed94f82b453df36e6e8eac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d236fd14cd49168a3842369badc524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:22.425747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1c94a949-8920-4228-b07a-311072d76119 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 200 len: 1329 microversion: 2.1 time: 0.104883 Aug 17 20:13:22.426313 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 436/844] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:22 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:23.151641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:23.152213 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:23.159194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:23.159775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:23.160175 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:23.160859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:23.161300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:23.161757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:23.295974 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:23.305557 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:23.307054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:13:23.308216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-08ae4c1a-9a33-4a71-8213-a993f41f83ed tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1794 microversion: 2.20 time: 0.160549 Aug 17 20:13:23.308783 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 409/845] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:13:23 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:13:23.447265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:23.447866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:23.454581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:23.455060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:23.455486 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:23.456176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:23.456619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:23.457104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:23.472656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b HTTP/1.1 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:13:23.474336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:23.475961 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '5ed07e8d-418a-4da5-afe7-a624bb8c849b'} Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:23.476976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:23.478552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:23.480448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:23.480448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a02f89dc-ab0e-4c55-b660-53d05a5bada1 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 404 len: 111 microversion: 2.1 time: 0.032423 Aug 17 20:13:23.480448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 437/846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:23 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:23.485097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7e707f23-864a-4676-869f-eeea09550309 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '.version_select at 0x7faaaca93a60>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:23.507148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7e707f23-864a-4676-869f-eeea09550309 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31353342" status: 202 len: 0 microversion: 2.1 time: 0.026091 Aug 17 20:13:23.507809 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 410/847] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Aug 17 20:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31353342 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:13:25.340435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:25.340943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:25.347976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:25.348457 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:25.348886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:25.349800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:25.350238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:25.350655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:25.364831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b HTTP/1.1 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:13:25.366418 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.367966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '5ed07e8d-418a-4da5-afe7-a624bb8c849b'} Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:25.368812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.370091 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.371306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:25.371306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5288d80b-7c99-41aa-9135-67cadc736ede tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 404 len: 111 microversion: 2.1 time: 0.031345 Aug 17 20:13:25.371306 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 438/848] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:13:25 2022] DELETE /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:25.377306 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:25.377978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 5ed07e8d-418a-4da5-afe7-a624bb8c849b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:25.384430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:25.384914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:25.385346 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:25.386082 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:25.386534 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:25.386957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:25.400527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b HTTP/1.1 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:13:25.402227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.403702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '5ed07e8d-418a-4da5-afe7-a624bb8c849b'} Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:25.404572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. Aug 17 20:13:25.406042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:25.407324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 5ed07e8d-418a-4da5-afe7-a624bb8c849b could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:25.407324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5a9f5807-7540-4130-818f-80fe872aea64 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b" status: 404 len: 111 microversion: 2.1 time: 0.030814 Aug 17 20:13:25.407324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 411/849] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:25 2022] GET /compute/v2.1/servers/5ed07e8d-418a-4da5-afe7-a624bb8c849b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:26.554219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:26.554900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:26.561336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.561840 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.562263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.562949 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.563390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.563799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.577777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a HTTP/1.1 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:13:26.579509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.581070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a'} Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:26.581999 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.583254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.584693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:26.584693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3c1d04c6-912d-4e54-a305-3654633489c4 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 404 len: 111 microversion: 2.1 time: 0.030963 Aug 17 20:13:26.584693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 439/850] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:13:26 2022] DELETE /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:26.589838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:26.590452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:26.597171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.597680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.598106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.598789 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.599231 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.599649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.613349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a HTTP/1.1 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:13:26.614938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.616538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a'} Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:26.621020 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. Aug 17 20:13:26.622701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.624283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:26.624283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7c55adfc-270a-4af3-9bd1-77f1d5c59662 tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a" status: 404 len: 111 microversion: 2.1 time: 0.030658 Aug 17 20:13:26.624283 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 412/851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:26 2022] GET /compute/v2.1/servers/a75972b6-a7cd-41a4-b7c8-5ecdfa6f2a9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:26.626318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:26.626811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:26.633332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.633841 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.634264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.635178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.635935 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.636633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.651867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 HTTP/1.1 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:13:26.653420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.654904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '958f5b11-f1b0-419c-9c9f-e7b3ee980ba6'} Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:26.655736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.657202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.658671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:26.658671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-336f41d0-c553-4eae-a180-4d1b26c584cd tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 404 len: 111 microversion: 2.1 time: 0.032393 Aug 17 20:13:26.658671 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 440/852] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:13:26 2022] DELETE /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:26.666084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:26.666903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:26.673617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.674082 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.674549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.675269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:26.675693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:26.676112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:26.690391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 HTTP/1.1 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:13:26.692005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.693738 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '958f5b11-f1b0-419c-9c9f-e7b3ee980ba6'} Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:26.694641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. Aug 17 20:13:26.696116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:26.697473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:26.697473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-df64412e-d3f7-45c7-9d17-3a1c03c34b2b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6" status: 404 len: 111 microversion: 2.1 time: 0.033428 Aug 17 20:13:26.697473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 413/853] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:26 2022] GET /compute/v2.1/servers/958f5b11-f1b0-419c-9c9f-e7b3ee980ba6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:27.842568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:27.843150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:27.850068 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:27.850587 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:27.851101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:27.851822 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:27.852280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:27.852723 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:27.866721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e HTTP/1.1 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:13:27.868277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.869873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '3b0cf12b-6cf9-4949-aca9-f97c710bdc8e'} Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:27.870960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.872566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.874264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:27.874264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-28ead344-f5fa-46f5-8926-761d0992ee7b tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 404 len: 111 microversion: 2.1 time: 0.031169 Aug 17 20:13:27.874264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 441/854] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:13:27 2022] DELETE /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:13:27.878494 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:27.879099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] [instance: 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:13:27.885881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:27.886354 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:27.886751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:27.887460 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:13:27.887897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:13:27.888300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:13:27.902219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] HTTP exception thrown: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Request method failure captured: Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e HTTP/1.1 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Uls-JVJvJzm-PhjPeUG2kOKpSD5H1CpKkJSc6-g64gp1fp7P9csBP7vZCEycM6H6oAXit9Yh3qE0KpHwFo1hhB-kaS4cAYvYMPSItfhfD5BeurhILnac9I7UxZA0dqpgC3Fe9TePZQ8w1oLapaAIiJvjXPYoNNaiioAYG2t7O0pvSE Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:13:27.903836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56d236fd14cd49168a3842369badc524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56d236fd14cd49168a3842369badc524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56d236fd14cd49168a3842369badc524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 56d236fd14cd49168a3842369badc524 Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545863562 Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 454c2bf24ed94f82b453df36e6e8eac1 Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-1545863562-project Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.905342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '3b0cf12b-6cf9-4949-aca9-f97c710bdc8e'} Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:13:27.906452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. Aug 17 20:13:27.908061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:13:27.912483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] Returning 404 to user: Instance 3b0cf12b-6cf9-4949-aca9-f97c710bdc8e could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:13:27.912483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b2ae06c0-04e1-4f73-986e-acc173e5902d tempest-AttachVolumeNegativeTest-1545863562 tempest-AttachVolumeNegativeTest-1545863562-project] 10.222.0.18 "GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e" status: 404 len: 111 microversion: 2.1 time: 0.030578 Aug 17 20:13:27.912483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 414/855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:13:27 2022] GET /compute/v2.1/servers/3b0cf12b-6cf9-4949-aca9-f97c710bdc8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:15:02.596624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=37 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:02.596624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=68 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:02.791568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-325ff4a6-8c3d-4418-bfd7-07851fe99058 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Action: 'create', calling method: .version_select at 0x7faaacabf280>, body: {"keypair": {"name": "tempest-TestShelveInstance-595245363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj9+MdypTz0wi5y0CQHprkOaV0O6i0OOJJBsqhDMqPBL/WHFHmiJEQzmlWPPhIcSn8fRp9mDelDxWn+AJ3/I77IitCQZLyVm4oumWzWL6YfeZ3YO+ZwtyjPvTqqe/PF5w=="}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:02.812696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-325ff4a6-8c3d-4418-bfd7-07851fe99058 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Getting quotas for project 458eee750aa741c493481ee785761172. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:15:02.818263 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-325ff4a6-8c3d-4418-bfd7-07851fe99058 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Getting quotas for user 112f1de9bcdc4b8fb3d402190d4f0751 and project 458eee750aa741c493481ee785761172. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:15:02.847719 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-325ff4a6-8c3d-4418-bfd7-07851fe99058 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.254877 Aug 17 20:15:02.848237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 442/856] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:15:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:14.008941 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.010050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.017248 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:14.018069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:14.027160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.027693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.028189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.029021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.029475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.029962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.061718 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-36c34e43-107b-4e99-97d6-3a15599bd217 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments/b116a354-5ee5-4982-b74c-c09d78b86ea1" status: 200 len: 194 microversion: 2.20 time: 0.055750 Aug 17 20:15:14.062292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 415/857] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Aug 17 20:15:14 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments/b116a354-5ee5-4982-b74c-c09d78b86ea1 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:15:14.139322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=4 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.140174 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.144479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:14.144973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:14.152176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.152657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.153092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.153811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.154259 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.154679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.238027 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lazy-loading 'services' on Instance uuid e40ce772-7f69-4c16-87d6-fa3ae625d7a4 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:15:14.314128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-28b03532-ceed-40a2-ac0c-b4801afb69df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments/b116a354-5ee5-4982-b74c-c09d78b86ea1" status: 202 len: 0 microversion: 2.20 time: 0.175974 Aug 17 20:15:14.314749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 443/858] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 17 20:15:14 2022] DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments/b116a354-5ee5-4982-b74c-c09d78b86ea1 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:15:14.324111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:14.326645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:14.333201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.333780 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.334255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.335083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:14.335684 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:14.336142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:14.367645 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1599756e-6333-48ef-98c2-ddf4c97b8818 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048306 Aug 17 20:15:14.368405 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 416/859] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 17 20:15:14 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:15:15.388137 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:15.392277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:15.401129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:15.401639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:15.402069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:15.402761 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:15.403217 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:15.403634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:15.434189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-64e91412-8304-4dd6-85f5-fe485e69a34b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054229 Aug 17 20:15:15.434751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 444/860] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 17 20:15:15 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:15:16.450065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:16.452603 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:16.461216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.461839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.462370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.463210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.463760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.464275 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.495793 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf481783-4bd8-4c8f-bf6d-b255648ed777 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051259 Aug 17 20:15:16.496297 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 417/861] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 17 20:15:16 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:16.565300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:16.565869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:16.573356 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.573850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.574277 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.574968 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.575411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.575820 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.602713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:15:16.685377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ed4476c4-68d3-44ca-a9c1-dac9abd177c3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 204 len: 0 microversion: 2.20 time: 0.123640 Aug 17 20:15:16.686001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 445/862] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 17 20:15:16 2022] DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:15:16.695422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:16.696136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:16.702086 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.702490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.702909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.703583 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:16.704029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:16.704438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:16.838597 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:16.846733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:16.848208 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:16.849481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-62f4a753-4f57-4b1f-9550-cc0024c8e5b8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.158378 Aug 17 20:15:16.850062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 418/863] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:16 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:17.877412 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:17.878598 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:17.889388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:17.890236 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:17.890953 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:17.892081 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:17.892822 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:17.893518 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:18.035843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:18.044063 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:18.045588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:18.046753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c29a6c27-355e-42ee-8f3f-6f222f3d12b7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.176593 Aug 17 20:15:18.047310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 446/864] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:17 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:19.082810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:19.083851 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:19.091743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:19.092233 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:19.092666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:19.093349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:19.093823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:19.094241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:19.231654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:19.239902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:19.241419 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:19.242659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-51007433-ad70-46cd-b799-3ae5fa83396f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1722 microversion: 2.20 time: 0.166329 Aug 17 20:15:19.243212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 419/865] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:19 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:20.146388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ce772-7f69-4c16-87d6-fa3ae625d7a4", "name": "network-vif-deleted", "tag": "23ef708b-13cb-4515-b92b-7b1266cf72b0"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:20.158072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:20.158834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:20.159426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:20.172232 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] Creating event network-vif-deleted:23ef708b-13cb-4515-b92b-7b1266cf72b0 for instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 on hv-cinder-82002 Aug 17 20:15:20.178039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-abd23fae-6518-46a2-92d5-bd5085d98a80 req-bf6da6bf-d2c7-4b9c-8a90-364c232d2904 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100074 Aug 17 20:15:20.179912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 447/866] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:20.265995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:20.266919 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:20.274306 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:20.274940 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:20.275477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:20.276292 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:20.277184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:20.277747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:20.310497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:20.311169 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:20.311667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:20.312186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lazy-loading 'fault' on Instance uuid e40ce772-7f69-4c16-87d6-fa3ae625d7a4 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:15:20.353802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:20.361897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:20.363365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:20.364518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6c88910c-b76a-4f11-9f10-6cb9ba470ec7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 200 len: 1372 microversion: 2.20 time: 0.102607 Aug 17 20:15:20.365286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 420/867] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:20 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:21.391569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:21.392669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:21.402494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:21.402965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:21.403388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:21.404276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:21.404583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:21.404919 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:21.418913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 HTTP/1.1 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:15:21.420527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:15:21.422527 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'e40ce772-7f69-4c16-87d6-fa3ae625d7a4'} Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:15:21.423451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:15:21.425077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:15:21.426812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:15:21.426812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-170ec628-6d6b-4781-b7bb-fec51e763495 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 404 len: 111 microversion: 2.20 time: 0.037551 Aug 17 20:15:21.426812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 448/868] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:21 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:15:21.431301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0cec7653-7803-4445-940e-7b11606b8151 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '.version_select at 0x7faaacb13040>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:21.454135 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0cec7653-7803-4445-940e-7b11606b8151 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600328072" status: 204 len: 0 microversion: 2.20 time: 0.027041 Aug 17 20:15:21.454659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 421/869] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Aug 17 20:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600328072 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:15:22.110814 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-25762dbb-eb17-4f9d-a091-02e287c2f2fb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: .version_select at 0x7faaaca7e9d0>, body: {"keypair": {"name": "tempest-keypair-1484138186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhfp/HpFfYVTnyzGJwnqr/53KkDuQpaibk+vt7Vvs8ovjXP3BF7FMdsc/npOt6BoED2fF7ivPNziJE0TqPYy8tCt3mRLmACfzKoX7MBTPBssxcoQYBFYTCF1w7Uc9lseg=="}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:22.128453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-25762dbb-eb17-4f9d-a091-02e287c2f2fb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:15:22.132648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-25762dbb-eb17-4f9d-a091-02e287c2f2fb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for user 31a49b84974b480985d0b002fc740e95 and project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:15:22.158846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-25762dbb-eb17-4f9d-a091-02e287c2f2fb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052130 Aug 17 20:15:22.159514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 449/870] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 17 20:15:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 20:15:23.447879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1735078501", "imageRef": "69349ded-c3df-4ad2-94b2-7d2720987912", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "689d8a20-5541-478f-99a7-dc99fc001e66"}], "security_groups": [{"name": "tempest-securitygroup--1049082677"}], "key_name": "tempest-keypair-1484138186", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:23.555291 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] validate_networks() for [('689d8a20-5541-478f-99a7-dc99fc001e66', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:15:23.657203 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-760366404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-595245363", "security_groups": [{"name": "tempest-secgroup-smoke-1596216059"}], "networks": [{"uuid": "5d5c5e4d-f33a-4b7b-a919-f29d09f11f17"}], "block_device_mapping_v2": [{"uuid": "152a4064-23ba-46c5-98a4-4564a2277f0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:23.786611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] validate_networks() for [('5d5c5e4d-f33a-4b7b-a919-f29d09f11f17', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:15:24.169643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:15:24.170063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:15:24.170696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:15:24.171111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:15:24.171515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:15:24.182042 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:24.182605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:24.183162 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:24.183882 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:24.184325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:24.184730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:24.205017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:15:24.208964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Getting quotas for user 31a49b84974b480985d0b002fc740e95 and project 129d0816f8ef4b4f8c8d626b49a03679. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:15:24.220246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:15:24.222588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69349ded-c3df-4ad2-94b2-7d2720987912',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:15:24.270592 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dcfdd6f2-db1f-4885-a1e8-aa4f8e598462 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.827189 Aug 17 20:15:24.271537 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 422/871] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 17 20:15:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 20:15:24.282083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:24.282713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:24.323282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:15:24.323769 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:15:24.324537 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:15:24.325415 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:15:24.325913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:15:24.336950 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:24.337698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:24.338148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:24.338885 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:24.339459 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:24.339566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:24.339893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:24.347196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:24.348847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:24.350059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7f7dbe13-1e9c-41f9-ab01-aae4ebde6b4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1282 microversion: 2.20 time: 0.071844 Aug 17 20:15:24.351194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 423/872] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:24 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:15:24.359562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Getting quotas for project 458eee750aa741c493481ee785761172. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:15:24.363946 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Getting quotas for user 112f1de9bcdc4b8fb3d402190d4f0751 and project 458eee750aa741c493481ee785761172. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:15:24.420736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:15:24.423843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='152a4064-23ba-46c5-98a4-4564a2277f0b',volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:15:24.563072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-67a02192-3cbd-40f6-8fe0-2447da98d175 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.909809 Aug 17 20:15:24.563895 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 450/873] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:15:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:15:24.576678 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-40f49199-5958-4ccc-a885-687fe098cf38 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:24.577286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-40f49199-5958-4ccc-a885-687fe098cf38 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:24.633074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-40f49199-5958-4ccc-a885-687fe098cf38 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:24.642488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-40f49199-5958-4ccc-a885-687fe098cf38 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1087 microversion: 2.1 time: 0.070572 Aug 17 20:15:24.643325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 424/874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:24 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:25.373225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:25.373896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:25.380531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:25.381003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:25.381432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:25.382380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:25.382830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:25.383213 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:25.460010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:25.468754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:25.470289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:25.471388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ffd6ff5f-8cac-4d6c-b6ce-cb7f669ceb4b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1342 microversion: 2.20 time: 0.102783 Aug 17 20:15:25.471937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 451/875] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:25 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:25.664170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:25.664759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:25.671958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:25.672429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:25.672855 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:25.673557 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:25.674014 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:25.674428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:25.742411 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:25.750455 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3efdaebc-318c-4e9b-a21d-0c6f41f75652 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1185 microversion: 2.1 time: 0.090337 Aug 17 20:15:25.751045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 425/876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:25 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:26.494599 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:26.495206 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:26.501726 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:26.502207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:26.502634 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:26.503329 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:26.503772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:26.504186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:26.577798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:26.586030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:26.587532 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:26.588698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-402f611f-ce8d-4d8a-9743-8c88ce812b26 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1340 microversion: 2.20 time: 0.098307 Aug 17 20:15:26.589260 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 452/877] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:26 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:26.774048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:26.774949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:26.798193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:26.799693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:26.800439 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:26.801895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:26.803925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:26.804751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:26.874441 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:26.882132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa14438e-2061-459b-8157-aec898f9c3ae tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1191 microversion: 2.1 time: 0.113634 Aug 17 20:15:26.882708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 426/878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:26 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:27.611801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:27.612402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:27.620311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:27.620833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:27.621382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:27.622662 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:27.623123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:27.623548 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:27.758660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:27.766896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:27.768393 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:27.769499 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a2216d92-6916-4f35-baf3-bd82a0c8ca55 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.161809 Aug 17 20:15:27.770088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 453/879] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:27 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:27.904679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:27.905264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:27.912041 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:27.912542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:27.912978 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:27.913730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:27.914182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:27.914604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:28.049115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:28.057264 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-80e98920-fa3b-4f60-b0ac-11e9e41a467a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.156790 Aug 17 20:15:28.057843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 427/880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:27 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:28.230745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:28.241611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:28.242089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:28.242517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:28.255009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] Creating event network-changed:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:15:28.260445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-a74551fe-3f96-4bfa-a139-8366a199eb4e req-8425ac16-2fed-4fef-955d-0e3bc32e5d35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034122 Aug 17 20:15:28.261223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 454/881] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:28.792465 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:28.793063 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:28.799208 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:28.799708 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:28.800134 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:28.800816 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:28.801254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:28.801922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:28.938173 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:28.946459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:28.948190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:28.949310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-10d2998c-f46c-4569-87e4-6f11fd63325b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.160855 Aug 17 20:15:28.949998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 428/882] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:28 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:29.079032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:29.079696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:29.086836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:29.087322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:29.087839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:29.088529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:29.088973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:29.089386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:29.224142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:29.232057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2c4f68f0-f8cf-4392-a33a-756e3bc12c61 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.157393 Aug 17 20:15:29.232623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 455/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:29 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:29.973206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:29.974171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:29.981178 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:29.981683 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:29.982113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:29.982799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:29.983245 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:29.983661 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:30.116567 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:30.129235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:30.131400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:30.134139 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1adc307f-d914-4b8b-b8dc-6150518d57d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.165232 Aug 17 20:15:30.134886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 429/884] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:29 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:30.252748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:30.253291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:30.260249 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:30.260729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:30.261156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:30.261896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:30.262324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:30.262737 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:30.276313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:30.286111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:30.286582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:30.287002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:30.298234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] Creating event network-changed:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:15:30.303662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-895e0fb2-9005-4d94-b5e2-5bad91b49866 req-1ad56913-4c6a-40db-ae80-2875f81b3dc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030830 Aug 17 20:15:30.304258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 430/885] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:30.396952 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:30.405677 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c5d534c5-3004-4772-bd7a-45f5c0e4f695 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.156882 Aug 17 20:15:30.406250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 456/886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:30 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:31.213733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:31.214458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:31.220754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:31.221227 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:31.221892 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:31.222748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:31.223372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:31.223869 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:31.354102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:31.362145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:31.363633 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:31.364730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-15c77786-a9ef-4812-8662-7e9d22b7d1a8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.211993 Aug 17 20:15:31.365301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 431/887] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:31 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:31.426519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:31.427112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:31.434395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:31.434876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:31.435308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:31.435995 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:31.436441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:31.436868 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:31.584782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:31.592487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d890381f-f133-44ed-a8dd-9ddb42942a8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.169899 Aug 17 20:15:31.593051 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 457/888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:31 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:32.387144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:32.387713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:32.394273 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:32.394773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:32.395267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:32.395964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:32.396408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:32.396824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:32.531955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:32.540632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:32.542148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:32.543257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf719cf1-d6e3-4b21-aecb-7c04d81b3358 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.160234 Aug 17 20:15:32.544209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 432/889] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:32 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:32.614332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:32.614940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:32.623025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:32.623501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:32.623905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:32.624590 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:32.625034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:32.625448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:32.758456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:32.766006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-26794f8e-8f0a-4719-bae0-fb67da1a9b13 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.157218 Aug 17 20:15:32.766576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 458/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:32 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:33.567701 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:33.568275 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:33.575365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:33.575871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:33.576321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:33.577048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:33.577515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:33.577982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:33.711728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:33.720206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:33.721736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:33.722833 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-817c4bb5-cf74-41e0-9e8d-1c4a9c9eae9e tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.159438 Aug 17 20:15:33.723369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 433/891] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:33 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:33.789833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:33.790419 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:33.797323 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:33.797835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:33.798268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:33.798963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:33.799414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:33.799833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:33.938036 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:33.945600 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9350cd62-74a9-4a50-b917-83f343a27750 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.161872 Aug 17 20:15:33.946180 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 459/892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:33 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:34.106938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "name": "network-vif-plugged", "status": "completed", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:34.116453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:34.116933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:34.117365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:34.128638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] Creating event network-vif-plugged:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:15:34.133665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-d186c64b-b893-43f7-8cee-f140ceb5c073 req-374c254c-2c8d-4537-934c-ef4385ca9de7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086647 Aug 17 20:15:34.134238 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 434/893] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:34.749142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:34.750289 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:34.753122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:34.754058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=10 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:34.761369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:34.761933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:34.762364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:34.763056 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:34.763503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:34.763952 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:34.899571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:34.903149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:34.908301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:34.909824 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:34.910969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ccc5442c-1450-48cb-ae5d-a38f23816757 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1408 microversion: 2.20 time: 0.168412 Aug 17 20:15:34.911547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 460/894] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:34 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:34.963874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:34.965403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=10 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:34.970040 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:34.970860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:34.977959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:34.978435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:34.978854 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:34.979533 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:34.979972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:34.980379 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:35.116390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:35.124222 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-181569f1-c911-44c7-8077-ebeab5f5b36d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.161439 Aug 17 20:15:35.124788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 435/895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:34 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:35.935647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:35.936369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:35.945519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:35.946163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:35.946700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:35.947520 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:35.947950 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:35.948375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:36.091198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:36.099614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:36.101117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:36.102308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9f268632-b553-4eee-8625-c63cfe5f1ba4 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1599 microversion: 2.20 time: 0.171709 Aug 17 20:15:36.102889 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 461/896] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:15:35 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:36.124401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:36.124934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:36.131415 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:36.131898 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:36.132328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:36.133017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:36.133469 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:36.133954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:36.139160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:36.145310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:36.145979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:36.159190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:36.159687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:36.160123 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:36.160825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:36.161274 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:36.161718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:36.238733 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cbfae8bd-856c-4b09-897a-4642e08bc525 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118340 Aug 17 20:15:36.239324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 436/897] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 17 20:15:36 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:15:36.306073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:36.313843 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-30df78d7-55d1-4a7d-aaf1-ff25c02f2457 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.172864 Aug 17 20:15:36.314410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 462/898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:36 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:37.202707 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:37.212462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:37.212929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:37.213343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:37.224268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] Creating event network-changed:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:15:37.229406 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-4f57db9e-5836-4b4e-9f83-a4698292d467 req-ae3c5554-37b0-4be3-aa78-4686cd982cd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030858 Aug 17 20:15:37.230058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 437/899] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:37.334651 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:37.335408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:37.342101 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:37.342580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:37.343017 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:37.343704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:37.344150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:37.344567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:37.483071 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:37.491466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-78546d8d-766d-4c3a-bbec-2e1a8ed0e87e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.160634 Aug 17 20:15:37.492154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 463/900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:37 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:38.513627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:38.514323 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:38.520966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:38.521449 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:38.521915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:38.522609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:38.523065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:38.523488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:38.655390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:38.663407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca637800-4b5d-48a7-9ab3-9c3469febcba tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.154703 Aug 17 20:15:38.663972 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 438/901] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:38 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:39.687869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:39.688485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:39.697839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:39.698363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:39.698790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:39.699476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:39.699920 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:39.700336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:39.840432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:39.851930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6e47cba4-a68c-4de6-aa1b-1ef4b90cf1ca tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.170091 Aug 17 20:15:39.852715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 464/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:39 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:40.876670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:40.877688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:40.888423 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:40.889209 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:40.890015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:40.891097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:40.891830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:40.892515 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:41.025311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:41.033043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bccc1862-e67b-44f4-842a-da3ce53a0a7e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.162770 Aug 17 20:15:41.033642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 439/903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:40 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:42.052948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.053941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:42.060856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:42.061330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:42.061785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:42.062496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:42.062973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:42.063388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:42.110987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "name": "network-vif-plugged", "status": "completed", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:42.121949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:42.122430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:42.123501 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:42.135131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] Creating event network-vif-plugged:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:15:42.140690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a03991a8-0821-4a2f-8bc1-f5366e789686 req-ebf2f097-0cab-46bf-a81f-276b8123f89c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Aug 17 20:15:42.141374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 440/904] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:42.202604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:42.210262 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-35f90130-9aee-42d0-bc3d-8011fa48dd0a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.161405 Aug 17 20:15:42.210838 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 465/905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:43.236676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:43.237900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:43.246853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:43.247335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:43.247766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:43.248457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:43.248907 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:43.249326 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:43.406384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:43.417652 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ddf06fd1-1dbf-4740-826f-545f1ce9b68c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1259 microversion: 2.1 time: 0.188828 Aug 17 20:15:43.418151 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 441/906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:43 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:44.442948 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:44.443943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:44.448493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:44.452213 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:44.452690 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:44.453116 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:44.453842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:44.454288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:44.454685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:44.592585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:44.604007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4ff3e133-b49f-4ba7-a5fd-3aac13ead8a2 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1443 microversion: 2.1 time: 0.167428 Aug 17 20:15:44.604707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 466/907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:44 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:44.624085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:44.624591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:15:44.627111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:44.632799 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:44.633275 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:44.633739 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:44.634440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:44.634867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:44.635304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:44.776871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:15:44.785130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6be77bd2-1839-4bdc-9229-99a3e09534a1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1443 microversion: 2.1 time: 0.164929 Aug 17 20:15:44.785728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 442/908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:15:44 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:46.458628 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:15:46.468096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:15:46.468562 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:15:46.468980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:15:46.481997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] Creating event network-changed:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:15:46.486957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-bd53e325-33a4-44b1-a069-a4816c444ca9 req-8eb86e0a-8d52-4ac1-843e-5f4adf861be8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032749 Aug 17 20:15:46.487544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 467/909] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:16:52.347422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:52.348587 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=30 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:52.355069 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:52.355554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:52.362256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:52.362741 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:52.363171 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:52.363848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:52.364288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:52.364705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:52.389377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3a4e452e-36c0-4618-9b1c-0dc78b6c52d7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/ips" status: 200 len: 150 microversion: 2.20 time: 0.044931 Aug 17 20:16:52.389967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 443/910] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 17 20:16:52 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:16:54.236390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:54.237528 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=38 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:54.244674 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:16:54.245292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:54.252588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:54.253069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:54.253496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:54.254212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:54.254656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:54.255070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:54.277915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lazy-loading 'flavor' on Instance uuid 15067821-b70c-49ae-8d33-b4ed23923775 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:16:54.465292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6cb2b12c-ba96-4177-af96-b41d7957ebe9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/action" status: 202 len: 0 microversion: 2.20 time: 0.232448 Aug 17 20:16:54.465957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 468/911] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 17 20:16:54 2022] POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:16:54.474623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:54.475954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:54.483161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:54.483638 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:54.484190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:54.484939 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:54.485378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:54.485886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:54.618312 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:54.630464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:54.632830 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:54.635335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d55c7ed1-ab89-450a-84eb-77e3a7a5d041 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.164982 Aug 17 20:16:54.635899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 444/912] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:16:54 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:16:55.670375 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:55.673028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:55.683832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:55.684313 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:55.684741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:55.685433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:55.685904 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:55.686305 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:55.832839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:55.846430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:55.848367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:55.850396 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-81a26f73-6e3d-4307-9a23-06a61da864df tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.187200 Aug 17 20:16:55.851267 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 469/913] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:16:55 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:16:56.874715 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:56.875319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:56.882169 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:56.882649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:56.883077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:56.883763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:56.884210 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:56.884640 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:57.021039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:57.029948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:57.031508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:57.032659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1f4b7004-cf4f-44ca-8959-b6094343ff80 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.161940 Aug 17 20:16:57.033251 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 445/914] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:16:56 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:16:58.059912 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:58.060687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:58.069055 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:58.069691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:58.070224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:58.071078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:58.071638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:58.072262 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:58.215679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:58.223914 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:58.225407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:58.226585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c0ec644f-f84b-45f2-b92b-b3e3e335bb3b tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.172942 Aug 17 20:16:58.227148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 470/915] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:16:58 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:16:59.253395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:16:59.254464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:16:59.265350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:59.266202 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:59.266936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:59.268065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:16:59.268856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:16:59.269527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:16:59.414606 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:59.422662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:59.424146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:16:59.425409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e9ee2260-c9d2-4e7c-a927-8dd2a7b9e2f9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.178705 Aug 17 20:16:59.426059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 446/916] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:16:59 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:00.453230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:00.454270 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:00.465413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:00.466257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:00.466966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:00.468093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:00.468834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:00.469584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:00.616364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:00.629741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:00.632032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:00.633901 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dc572ff8-636e-4160-8564-638a5f4d3d70 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.187009 Aug 17 20:17:00.634864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 471/917] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:00 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:01.661729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:01.662761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:01.673727 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:01.674528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:01.675396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:01.676522 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:01.677260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:01.677995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:01.823072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:01.831446 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:01.832931 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:01.834111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-23c33745-401d-434c-aa1e-ddaf65a46c93 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.179400 Aug 17 20:17:01.834665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 447/918] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:01 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:02.859160 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:02.859836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:02.866326 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:02.866807 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:02.867251 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:02.867938 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:02.868384 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:02.868797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:03.012362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:03.020417 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:03.021926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:03.023075 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1c452114-54e7-4e01-adf1-57579be78996 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.167920 Aug 17 20:17:03.023648 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 472/919] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:02 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:04.047872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:04.048510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:04.055878 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:04.056359 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:04.056777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:04.057475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:04.057953 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:04.058364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:04.189961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:04.198057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:04.199550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:04.200747 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3180f55-726e-4fb0-9070-a465604f79e6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.157146 Aug 17 20:17:04.201306 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 448/920] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:04 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:05.223873 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:05.225064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:05.232039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:05.232510 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:05.232940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:05.233659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:05.234276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:05.234531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:05.367032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:05.375286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:05.376777 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:05.377989 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-52ce470c-6c90-4816-b201-52dd7c5eb215 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.157988 Aug 17 20:17:05.378551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 473/921] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:05 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:06.400997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:06.401622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:06.408038 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:06.408891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:06.409027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:06.409760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:06.410211 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:06.410632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:06.544122 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:06.552337 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:06.554136 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:06.555304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-28862007-ce01-48bd-91f0-6b2ef937edd8 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1744 microversion: 2.20 time: 0.158688 Aug 17 20:17:06.555845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 449/922] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:06 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:07.579558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:07.580125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:07.586772 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:07.587241 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:07.587664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:07.588337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:07.588776 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:07.589188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:07.726670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:07.734910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:07.736325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:07.737506 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-74e69d6f-e622-439a-b2cd-a3cfe24ed711 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1744 microversion: 2.20 time: 0.162040 Aug 17 20:17:07.738094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 474/923] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:07 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:08.493176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "name": "network-vif-plugged", "status": "completed", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:17:08.504774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:08.505275 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:08.505730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:08.669988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] Creating event network-vif-plugged:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:17:08.675505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-8232978d-cbd3-4555-b0a7-90e9929fbc69 req-2ebe2feb-1ffc-4f2d-b662-72d93dbdc71d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186097 Aug 17 20:17:08.676215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 450/924] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:17:08.767254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:08.768509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:08.779096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:08.779940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:08.780583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:08.781881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:08.782382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:08.782795 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:08.918607 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:08.930034 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:08.932373 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:08.934098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c4e4c8bc-22b4-4ad3-8c84-a518ee86031c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1744 microversion: 2.20 time: 0.176207 Aug 17 20:17:08.934870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 475/925] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:08 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:09.963961 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:09.965084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:09.977114 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:09.977955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:09.978665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:09.979841 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:09.980611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:09.981294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:10.332609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:10.344328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:10.346448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:10.347623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-81ec9c68-5b8c-458f-b072-6b1aa8ffeeff tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1744 microversion: 2.20 time: 0.391715 Aug 17 20:17:10.348163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 451/926] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:09 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1744 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:11.381774 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:11.382523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:11.390786 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:11.391401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:11.391941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:11.392886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:11.393353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:11.393740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:11.524799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:11.534663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:11.536168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:11.537328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-da9c32f2-fbab-4c88-a560-c77bf2268ca9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1744 microversion: 2.20 time: 0.160919 Aug 17 20:17:11.537911 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 476/927] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:11 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:12.560875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:12.561560 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:12.568676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:12.569163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:12.569625 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:12.570514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:12.571109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:12.571677 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:12.727475 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:12.736094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:12.737755 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:12.738963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9422238c-d70d-4724-b79f-2f0a26fd1b0c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.182333 Aug 17 20:17:12.739509 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 452/928] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:12 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:13.763088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:13.763702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:13.771143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:13.771925 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:13.772579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:13.773282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:13.773966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:13.774368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:13.925657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:13.937842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:13.939542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:13.941027 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c3e528c3-1111-43f2-a94d-be3e96f845ac tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.182135 Aug 17 20:17:13.942663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 477/929] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:13 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:14.966235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:14.966838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:14.975392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:14.975945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:14.976447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:14.977405 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:14.977937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:14.978422 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:15.126963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:15.135575 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:15.138466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:15.140383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-582c5397-0e66-4b61-af17-63f879001bdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.177877 Aug 17 20:17:15.158313 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 453/930] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:14 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:16.164132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:16.164751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:16.171872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:16.172349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:16.172781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:16.173465 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:16.173941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:16.174359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:16.317730 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:16.327849 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:16.329330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:16.330733 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f094d213-a8b9-4f59-b1ab-761452716edf tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.170530 Aug 17 20:17:16.331522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 478/931] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:16 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:17:17.356873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:17.357804 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:17.364791 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:17.365294 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:17.365934 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:17.366476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:17.366917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:17.367328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:17.517759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:17.526643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:17.528323 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:17.529483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9d3e8a20-eb75-4da3-ba04-40a9b6bccfdd tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.176690 Aug 17 20:17:17.541555 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 454/932] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:17 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:18.552257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:18.552863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:18.560881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:18.561390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:18.561866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:18.562745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:18.563218 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:18.563636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:18.706495 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:18.714861 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:18.716345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:18.717630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-407bf2e6-aefa-4b3a-9f34-30fae16c382c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.169123 Aug 17 20:17:18.732787 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 479/933] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:18 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:19.742589 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:19.743885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:19.751702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:19.752190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:19.752607 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:19.753293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:19.753763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:19.754178 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:19.946842 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:19.959065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:19.960585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:19.962486 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-03bf3b92-8c78-41fc-9086-177c6c305df7 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.225847 Aug 17 20:17:19.978382 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 455/934] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:19 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:20.986695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:20.987346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:20.994749 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:20.995597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:20.996010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:20.996705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:20.997156 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:20.997597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:21.131870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:21.143063 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:21.145129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:21.146854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-be3c8a02-0876-40c9-99c1-4d3d12a0560c tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1739 microversion: 2.20 time: 0.164074 Aug 17 20:17:21.147413 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 480/935] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:20 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:22.169214 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:22.169873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:22.176534 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:22.177002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:22.177435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:22.178164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:22.178929 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:22.179389 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:22.310573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:22.318605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:22.320164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:22.321316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ddc8df9a-238b-4beb-a63c-92f9de782238 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1721 microversion: 2.20 time: 0.155996 Aug 17 20:17:22.321870 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 456/936] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:22 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:23.347681 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:23.348341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:23.357926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:23.358640 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:23.359248 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:23.360308 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:23.360943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:23.361652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:23.499131 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:23.511239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:23.513597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:23.515353 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c28f6730-4b77-4bd1-b724-37935c00f479 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1721 microversion: 2.20 time: 0.174087 Aug 17 20:17:23.516166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 481/937] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:23 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:24.540088 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:24.540691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:24.543131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=29 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:24.548662 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:24.549145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:24.549566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:24.550286 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:24.550736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:24.551137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:24.554271 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=79 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:24.691262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:24.701344 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:24.703015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:24.704165 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a8bfc040-6565-4303-8541-79be74f15901 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1664 microversion: 2.20 time: 0.169034 Aug 17 20:17:24.704758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 457/938] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:24 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:24.728299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610f34a3-f5df-4dd8-a730-7f9df65f0513"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:17:24.730782 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:24.733173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=29 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:24.738811 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:24.739280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:24.739702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:24.740378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:24.740819 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:24.741227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:24.743721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:25.054677 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-18c4ec38-c161-40c8-92a6-beb2a4f71dba tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331821 Aug 17 20:17:25.055286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 482/939] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 17 20:17:24 2022] POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:17:25.176362 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:25.176853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:25.184112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.184596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.185031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.185759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.186207 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.186631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.466476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca993134-0735-434d-8a83-e152f9266bcb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments/610f34a3-f5df-4dd8-a730-7f9df65f0513" status: 202 len: 0 microversion: 2.20 time: 0.293855 Aug 17 20:17:25.467225 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 458/940] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 17 20:17:25 2022] DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments/610f34a3-f5df-4dd8-a730-7f9df65f0513 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:17:25.535443 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:17:25.536040 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:25.542525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.543006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.543439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.544140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.544578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.545000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.632268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120819) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:17:25.704164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2d7b416c-880c-41df-8dec-5dfdf76aa190 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/action" status: 202 len: 0 microversion: 2.20 time: 0.172704 Aug 17 20:17:25.704876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 483/941] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 17 20:17:25 2022] POST /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:17:25.713471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:25.714190 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:25.721900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.722454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.722949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.723668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:25.724115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:25.724529 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:25.854204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:25.862623 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:25.864120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:25.865288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b2982ac1-7a74-416b-88ca-1275a27fe50a tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1672 microversion: 2.20 time: 0.155965 Aug 17 20:17:25.865886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 459/942] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:25 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:17:26.571060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "name": "network-vif-unplugged", "status": "completed", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:17:26.580705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:26.581173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:26.581632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:26.593305 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.compute.server_external_events [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] Unable to find a host for instance 15067821-b70c-49ae-8d33-b4ed23923775. Dropping event network-vif-unplugged {{(pid=120819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 20:17:26.594226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-e3b77de2-e3b6-4479-8f22-221097d47a24 req-c850d6b9-ee62-461b-a34a-8f9bce402923 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028897 Aug 17 20:17:26.594808 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 484/943] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 20:17:26.888485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:26.889058 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:26.896019 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:26.896426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:26.896856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:26.897568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:26.898062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:26.898479 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:27.036061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:27.048620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:27.050912 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:27.052609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5938dd5a-4755-44c1-a67e-05d88eb52da1 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1674 microversion: 2.20 time: 0.167899 Aug 17 20:17:27.053182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 460/944] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:26 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:28.076793 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:28.077376 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:28.084456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:28.084987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:28.085498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:28.086438 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:28.086968 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:28.087424 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:28.231150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:28.239509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:28.241173 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:28.242389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d9d826d4-9089-4e2a-aca5-3a2957989975 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.169723 Aug 17 20:17:28.242958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 485/945] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:28 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:29.265981 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:29.266688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:29.274121 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:29.274785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:29.275215 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:29.275923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:29.276369 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:29.276786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:29.416979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:29.426045 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:29.427538 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:29.429109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c82b46ce-931d-4f66-be69-10ede321e917 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.167163 Aug 17 20:17:29.429697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 461/946] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:29 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:30.452380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:30.453050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:30.460110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:30.460596 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:30.461022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:30.461964 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:30.462611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:30.463031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:30.600098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:30.608969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:30.610830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:30.612341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-efb11b3c-5c92-45dd-a8af-fd778504fad9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.164020 Aug 17 20:17:30.613433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 486/947] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:30 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:17:31.635480 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:31.636224 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:31.643141 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:31.643614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:31.644037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:31.644721 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:31.645159 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:31.645740 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:31.796628 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:31.806620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:31.808148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:31.809308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c1c49683-47bb-45d4-9e4f-1a35a955fcdc tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.177972 Aug 17 20:17:31.809905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 462/948] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:31 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:32.832404 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:32.832984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:32.839712 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:32.840191 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:32.840621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:32.841316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:32.841799 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:32.842221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:33.152092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:33.160163 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:33.161694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:33.162869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-be471501-72dc-484d-b0a6-7d067f0c1b47 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.334594 Aug 17 20:17:33.171533 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 487/949] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:32 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:34.185867 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:34.186554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:34.203412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:34.203968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:34.204338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:34.205059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:34.205501 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:34.205938 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:34.345133 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:34.353184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:34.354698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:34.355894 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1ed293c8-f668-40c3-9271-21de9971e467 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.174066 Aug 17 20:17:34.356573 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 463/950] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:34 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:35.379494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:35.380139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:35.386608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:35.387087 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:35.387516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:35.388201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:35.388649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:35.389064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:35.527164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:35.535485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:35.536992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:35.538171 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f10b09a1-ee8a-4047-ab50-576c98739b43 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.162690 Aug 17 20:17:35.544907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 488/951] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:35 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:36.569370 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:36.569999 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:36.576831 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:36.577316 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:36.577781 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:36.578488 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:36.579208 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:36.579790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:36.711068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:36.719501 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:36.720989 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:36.722170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-702e3999-c857-49e9-a6af-82ede22b2d7f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.157612 Aug 17 20:17:36.722722 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 464/952] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:36 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:37.749395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:37.750378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:37.761638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:37.762476 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:37.763202 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:37.764392 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:37.765103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:37.765856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:37.910584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:37.920917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:37.922444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:37.923638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-49986734-386f-4661-b5dd-ae12bfa168c6 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.180900 Aug 17 20:17:37.924157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 489/953] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:37 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:38.959591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:38.960582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:38.969462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:38.969960 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:38.970384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:38.971071 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:38.971512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:38.972049 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:39.122068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:39.130469 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:39.132015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:39.133175 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-faccc725-1e47-482f-bd2c-470a3489e2b3 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.180352 Aug 17 20:17:39.133788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 465/954] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:38 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:40.160616 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:40.161643 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:40.171235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:40.171717 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:40.172146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:40.172872 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:40.173319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:40.173773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:40.304047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:40.316100 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:40.318430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:40.320168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-dd34b740-a678-4d55-8ba2-674aa560ed81 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.165982 Aug 17 20:17:40.320979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 490/955] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:40 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:41.348092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:41.348983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:41.359206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:41.359962 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:41.360626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:41.361822 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:41.362434 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:41.363074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:41.538073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:41.546442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:41.547921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:41.549065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9208a108-4c75-456e-8dba-31010ac45fa5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.207203 Aug 17 20:17:41.549648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 466/956] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:41 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:42.572114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:42.572963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:42.580343 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:42.580851 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:42.581287 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:42.582025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:42.582481 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:42.582974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:42.713809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:42.722066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:42.723554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:42.724740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f21a131b-d0bd-4809-97af-c19d2c6697e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.156757 Aug 17 20:17:42.725299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 491/957] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:42 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:43.752706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:43.753885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:43.764364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:43.764849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:43.765277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:43.766006 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:43.766458 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:43.766874 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:43.899777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:43.911147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:43.913445 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:43.915228 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ecce95c2-8e5b-4839-a4a6-2e854ff4acfb tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.169250 Aug 17 20:17:43.915818 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 467/958] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:43 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:44.688809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "name": "network-vif-plugged", "status": "completed", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:17:44.699028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:44.699493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:44.699916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:44.711973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] Creating event network-vif-plugged:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:17:44.717201 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-70e52543-37db-499c-aedb-bcb43a41604f req-4371def7-760c-4393-af75-05074db28406 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Aug 17 20:17:44.717866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 492/959] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:17:44.938937 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:44.939724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:44.946482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:44.946963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:44.947393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:44.948072 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:44.948518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:44.948932 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:45.081147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:45.089401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:45.090927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:45.092160 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-858f17b1-02ed-4fe4-9e15-543aec102292 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.157202 Aug 17 20:17:45.092703 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 468/960] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:44 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:46.120470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:46.121597 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:46.132208 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:46.133002 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:46.133766 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:46.134908 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:46.135662 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:46.136361 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:46.333045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:46.343583 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:46.345083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:46.346330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-570066a1-7234-4800-ab69-c75afdc0ada9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1730 microversion: 2.20 time: 0.233970 Aug 17 20:17:46.346960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 493/961] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:46 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:17:47.372669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:17:47.373266 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:17:47.381125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:47.381618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:47.382022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:47.382730 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:17:47.383170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:17:47.383616 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:17:47.578864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:47.587268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:47.588754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:17:47.589927 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb4c6046-0c16-4dd2-af20-707fde27fd97 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1717 microversion: 2.20 time: 0.223738 Aug 17 20:17:47.590453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 469/962] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:17:47 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1717 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:18:02.423652 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:18:02.424580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:02.428052 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:02.428695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:02.435493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:02.435987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:02.436411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:02.437067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:02.437509 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:02.437941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:02.464271 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lazy-loading 'flavor' on Instance uuid 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:18:02.540584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-82a6c93e-e465-4d28-9bdc-c6427a53a2b3 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "POST /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f/action" status: 202 len: 0 microversion: 2.1 time: 0.123366 Aug 17 20:18:02.541178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 494/963] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:18:02 2022] POST /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:18:02.549821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:02.550511 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:02.553196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=25 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:02.554433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:02.560327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:02.560832 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:02.561330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:02.562067 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:02.562517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:02.562921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:02.695010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:02.705425 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-48138236-4c54-4416-b272-6f6bf46ef482 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.159389 Aug 17 20:18:02.706320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 470/964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:02 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:03.739355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:03.740525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:03.753830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:03.754636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:03.755345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:03.756280 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:03.756728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:03.757149 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:03.912001 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:03.920621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-48520cce-752d-4735-a87d-0546cf7fc201 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.188385 Aug 17 20:18:03.921409 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 495/965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:03 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:04.942456 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:04.943047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:04.949656 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:04.950130 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:04.950658 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:04.951379 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:04.951821 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:04.952234 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:05.087217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:05.095459 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-57d39ee1-7636-43cb-b900-9ea60cb5b25c tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.157072 Aug 17 20:18:05.096027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 471/966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:04 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:06.119170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:06.119810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:06.126884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:06.127369 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:06.127797 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:06.128500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:06.128946 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:06.129365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:06.270325 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:06.279169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ae173e2c-e74b-4847-9d38-8e0658a2c9be tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.164428 Aug 17 20:18:06.279729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 496/967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:06 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:07.303508 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:07.304593 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:07.314440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:07.315144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:07.315667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:07.316685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:07.317323 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:07.317965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:07.455174 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:07.463199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d95e7604-83ff-4be8-8cca-20bbb7d339a0 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.166119 Aug 17 20:18:07.463776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 472/968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:07 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:08.490359 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:08.491311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:08.498356 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:08.498834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:08.499254 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:08.499939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:08.500380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:08.500795 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:08.640612 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:08.648905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-760177c2-cff2-4368-b9e5-bdc325a44cec tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.165413 Aug 17 20:18:08.649489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 497/969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:08 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:09.679527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:09.680491 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:09.691405 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:09.692180 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:09.692891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:09.694144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:09.694897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:09.695595 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:09.844568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:09.852823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ec1973a5-2beb-4b80-a809-0d8e90368569 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.180196 Aug 17 20:18:09.853379 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 473/970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:09 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:10.883016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:10.883881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:10.891169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:10.891645 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:10.892069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:10.892758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:10.893200 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:10.893646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:11.035367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:11.043031 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fa5877c5-2b19-43fc-a337-b9cd857eafc6 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.166628 Aug 17 20:18:11.043599 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 498/971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:10 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:12.068144 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:12.069070 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:12.079862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:12.080666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:12.081367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:12.082551 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:12.083293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:12.083982 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:12.221120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:12.233052 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-38781b81-7a3a-4736-9cc1-e29ab26cb660 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.171174 Aug 17 20:18:12.233954 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 474/972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:12 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:13.258977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:13.259863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:13.266869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:13.267316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:13.267738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:13.268428 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:13.268947 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:13.269382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:13.402529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:13.410264 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-14af0459-3fdb-4b5f-bc12-928cdfaccd0d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.155431 Aug 17 20:18:13.410729 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 499/973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:13 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:14.435186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:14.435996 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:14.445003 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:14.445680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:14.446260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:14.447156 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:14.447786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:14.448347 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:14.589010 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:14.597050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1aa4e8e3-0ea6-491f-9a0b-1a7d6f8f5e8d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.168255 Aug 17 20:18:14.597643 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 475/974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:14 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:15.620957 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:15.621834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:15.630853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.631498 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.632076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:15.633004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.633615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.634211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:15.776257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:15.783977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-eb4a8039-7d03-45e8-96e4-574fb566f9ce tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1569 microversion: 2.1 time: 0.168489 Aug 17 20:18:15.784505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 500/975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:15 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:15.804696 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:18:15.805284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:15.812157 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.812716 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.813161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:15.813903 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.814536 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.814949 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:15.847301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120818) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:18:15.917817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ae30d17-d78d-4297-a021-6401b13ffef7 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "POST /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f/action" status: 202 len: 0 microversion: 2.1 time: 0.117296 Aug 17 20:18:15.918409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 476/976] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:18:15 2022] POST /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:18:15.926407 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:15.927006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:15.933235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.933758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.934194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:15.935154 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:15.935622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:15.936030 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:16.102856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:16.110541 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6b710694-6cce-4392-9749-b682ae60c110 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1517 microversion: 2.1 time: 0.187933 Aug 17 20:18:16.111102 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 501/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:15 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:17.132090 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:17.132665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:17.139029 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:17.139544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:17.140137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:17.141333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:17.141950 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:17.142544 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:17.278984 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:17.286709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-53971793-28fb-4217-abe2-cb71bd98bd07 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1519 microversion: 2.1 time: 0.159157 Aug 17 20:18:17.287263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 477/978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:17 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:18.308337 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:18.308941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:18.316104 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:18.316584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:18.317035 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:18.317762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:18.318186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:18.318600 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:18.452766 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:18.460618 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c73c131a-9a8e-4eed-833c-218e4314b1a8 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.156554 Aug 17 20:18:18.461192 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 502/979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:18 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:18.849570 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "name": "network-vif-unplugged", "status": "completed", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:18:18.861518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:18.862027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:18.862448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:18.873713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] Creating event network-vif-unplugged:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:18:18.878810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-390b4eab-9b2d-4937-aa93-8352a3f785bf req-c6165397-447b-426e-a1c6-fe983ffcbbb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033288 Aug 17 20:18:18.879395 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 478/980] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:18:19.485742 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:19.486684 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:19.497867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:19.498664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:19.499380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:19.500706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:19.501150 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:19.501561 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:19.639633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:19.648072 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4a2041cd-d603-48dc-a3ef-a2d86f1abd33 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.168866 Aug 17 20:18:19.648675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 503/981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:19 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:20.669569 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:20.670246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:20.677093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:20.677571 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:20.678039 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:20.678736 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:20.679542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:20.679968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:20.814402 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:20.822365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f99559da-2173-4e3f-b29c-6171c834ca8a tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.157566 Aug 17 20:18:20.822879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 479/982] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:20 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:21.847088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:21.847773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:21.855852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:21.856422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:21.856933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:21.857787 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:21.858322 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:21.858812 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:22.007233 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:22.018516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c0b5b213-3912-4ad8-a300-940b5fb97752 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.177561 Aug 17 20:18:22.019083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 504/983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:21 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:23.050542 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:23.051482 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:23.062914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:23.063517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:23.063973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:23.064666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:23.065112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:23.065531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:23.207948 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:23.220044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c0a38cd6-f610-4315-8952-045560d5e0cd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.176290 Aug 17 20:18:23.220608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 480/984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:23 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:24.245285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:24.246285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:24.257473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:24.258323 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:24.259036 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:24.260215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:24.260926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:24.261632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:24.401892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:24.413514 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0038ca38-8577-4287-8ee7-dac86114076b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.174757 Aug 17 20:18:24.414519 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 505/985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:24 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:25.440348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:25.440997 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:25.447856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:25.448338 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:25.448763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:25.449448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:25.449925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:25.450350 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:25.592920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:25.600846 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ffe46b2b-5e40-4d36-a2a2-0656f2286ea4 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.165570 Aug 17 20:18:25.601493 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 481/986] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:25 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:26.626319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:26.627319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:26.638372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:26.639215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:26.639896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:26.641219 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:26.641694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:26.642128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:26.788689 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:26.796706 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ac5952e1-48b3-433e-a806-ff670cae482f tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1575 microversion: 2.1 time: 0.177166 Aug 17 20:18:26.797286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 506/987] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:26 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:27.818622 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:27.819223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:27.826357 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:27.826829 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:27.827253 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:27.827935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:27.828391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:27.828796 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:27.969142 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:27.980726 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3903976d-073f-4ee5-adee-442f50a9e53b tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1562 microversion: 2.1 time: 0.165929 Aug 17 20:18:27.981497 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 482/988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:18:27 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:28.976080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "name": "network-vif-plugged", "status": "completed", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:18:28.990284 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:28.990995 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:28.991646 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:29.005015 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] Creating event network-vif-plugged:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:18:29.010268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-2ad68646-c4c7-4493-8909-cce6c7f1d9a4 req-fd2ef860-647d-4524-8bfd-6881b4f88213 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038100 Aug 17 20:18:29.010928 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 507/989] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:18:42.989959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:42.992249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:42.994478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:42.995158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:43.002147 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.002731 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.003195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.003906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.004351 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.004767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.051945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f2473d48-47c5-497c-96c2-0072b5bb7b18 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066530 Aug 17 20:18:43.054440 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 483/990] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 17 20:18:42 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:18:43.115906 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=28 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:43.116649 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:18:43.120951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:43.121556 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:43.129167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.129867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.130282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.130976 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.131421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.131835 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.159695 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:18:43.243089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e89aa938-45a0-4a2e-8b56-12c6e3d5eb3f tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 204 len: 0 microversion: 2.20 time: 0.128330 Aug 17 20:18:43.243739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 508/991] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 17 20:18:43 2022] DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:18:43.255161 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:43.256489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:43.265900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.266742 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.267505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.268333 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:43.268780 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:43.269195 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:43.404812 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:43.413315 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:43.414871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:43.416021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eace2c2f-8dc5-4b58-8530-3e3678aac7be tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.167624 Aug 17 20:18:43.416636 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 484/992] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:43 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:18:44.444801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:44.445576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:44.456566 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:44.457291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:44.457768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:44.458465 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:44.458917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:44.459364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:44.614114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:44.623153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:44.625089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:44.626318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-90c4a95e-b1c1-40d2-8374-7b0a4383f968 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1723 microversion: 2.20 time: 0.189126 Aug 17 20:18:44.626881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 509/993] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:44 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:18:45.650432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:45.651047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:45.657568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:45.658047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:45.658474 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:45.659165 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:45.659599 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:45.660014 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:45.733365 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:45.741609 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:45.743117 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a49b84974b480985d0b002fc740e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129d0816f8ef4b4f8c8d626b49a03679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:18:45.744308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ea2d5f1c-3882-4bcd-8533-b82319ad08b9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 200 len: 1655 microversion: 2.20 time: 0.097892 Aug 17 20:18:45.745077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 485/994] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:45 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:18:45.966028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15067821-b70c-49ae-8d33-b4ed23923775", "name": "network-vif-deleted", "tag": "0f0232f2-375b-43e8-a77d-73345e4c169a"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:18:45.976247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:45.976800 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:45.977225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:45.988517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] Creating event network-vif-deleted:0f0232f2-375b-43e8-a77d-73345e4c169a for instance 15067821-b70c-49ae-8d33-b4ed23923775 on hv-cinder-82002 Aug 17 20:18:45.993636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-9e443505-7362-4dfb-a1a4-67d3710ba493 req-21130f8b-fbcc-435f-a5da-9efd97348489 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Aug 17 20:18:45.997083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 510/995] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:18:46.767697 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:46.768356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:46.775509 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:46.776005 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:46.776432 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:46.777095 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:46.777756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:46.778339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:46.793116 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 HTTP/1.1 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:18:46.795016 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:46.796751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '15067821-b70c-49ae-8d33-b4ed23923775'} Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:18:46.797691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:46.799325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:46.800704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:18:46.800704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8f833ff7-f526-4163-8a8a-f5e3cb691bab tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 404 len: 111 microversion: 2.20 time: 0.032844 Aug 17 20:18:46.800704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 486/996] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:46 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:18:46.810238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-26667b9b-5c68-4902-9e9e-497e18afbb05 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '.version_select at 0x7faaaca84c10>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:46.831910 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-26667b9b-5c68-4902-9e9e-497e18afbb05 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484138186" status: 204 len: 0 microversion: 2.20 time: 0.026114 Aug 17 20:18:46.832693 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 511/997] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Aug 17 20:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484138186 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:18:48.788304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:48.788859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:48.795836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:48.796322 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:48.796759 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:48.797457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:48.797945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:48.798372 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:48.813256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 HTTP/1.1 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:18:48.814873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.816530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '15067821-b70c-49ae-8d33-b4ed23923775'} Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:18:48.817453 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.818987 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.820631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:18:48.820631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c3cd05a5-90bb-4d3e-80c5-f225f847d620 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 404 len: 111 microversion: 2.20 time: 0.032060 Aug 17 20:18:48.820631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 487/998] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 17 20:18:48 2022] DELETE /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:18:48.825398 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:48.826115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: 15067821-b70c-49ae-8d33-b4ed23923775] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:48.833960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:48.834439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:48.834866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:48.835565 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:48.836012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:48.836433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:48.850448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 HTTP/1.1 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:18:48.852364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.854452 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '15067821-b70c-49ae-8d33-b4ed23923775'} Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:18:48.855422 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. Aug 17 20:18:48.857061 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:48.858448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance 15067821-b70c-49ae-8d33-b4ed23923775 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:18:48.858448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1dd95cc9-4999-4ec6-95f4-49a4403167c0 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775" status: 404 len: 111 microversion: 2.20 time: 0.032856 Aug 17 20:18:48.858448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 512/999] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:48 2022] GET /compute/v2.1/servers/15067821-b70c-49ae-8d33-b4ed23923775 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:18:50.007007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:50.007675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:50.014876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:50.015438 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:50.015952 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:50.016694 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:50.017164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:50.017588 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:50.031510 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 HTTP/1.1 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:18:50.033115 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.034774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': 'e40ce772-7f69-4c16-87d6-fa3ae625d7a4'} Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:18:50.035837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.037348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.039120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:18:50.039120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-94b2b770-beb3-411d-9fc8-03a0c405acd5 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 404 len: 111 microversion: 2.20 time: 0.031561 Aug 17 20:18:50.039120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 488/1000] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 17 20:18:50 2022] DELETE /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:18:50.044331 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:18:50.045026 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] [instance: e40ce772-7f69-4c16-87d6-fa3ae625d7a4] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:18:50.053482 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:50.054614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:50.055120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:50.056226 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:18:50.056809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:18:50.057466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:18:50.073315 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] HTTP exception thrown: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Request method failure captured: Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 HTTP/1.1 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_Us23p_C3djZSylu_CC96Mbs_JwQ2yfPjlTZ-SwwmhTx07iUOAvT-oSa5aHXGQ1hdzEZFxzqzp2yQ7caU_Lio-Fisexa4glrb8j7CjYNZ0n7VZfmoRC-iebEmuSaE1AsoCZS9235mVrqnl9r1AbxpIGCmKwQYZR_Hgt1CuaZZqTK1BU Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:18:50.075296 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d0816f8ef4b4f8c8d626b49a03679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 129d0816f8ef4b4f8c8d626b49a03679 Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81488075 Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 31a49b84974b480985d0b002fc740e95 Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81488075-project Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.076971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'e40ce772-7f69-4c16-87d6-fa3ae625d7a4'} Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:18:50.077917 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. Aug 17 20:18:50.079189 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:18:50.080301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] Returning 404 to user: Instance e40ce772-7f69-4c16-87d6-fa3ae625d7a4 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:18:50.080301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0d9cd336-63fb-4867-9dfa-6ee7b83df7e9 tempest-AttachVolumeShelveTestJSON-81488075 tempest-AttachVolumeShelveTestJSON-81488075-project] 10.222.0.18 "GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4" status: 404 len: 111 microversion: 2.20 time: 0.037150 Aug 17 20:18:50.080301 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 513/1001] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 17 20:18:50 2022] GET /compute/v2.1/servers/e40ce772-7f69-4c16-87d6-fa3ae625d7a4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:19:35.629471 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-97f586bc-19db-46ef-bd76-1f85dc1354a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'create', calling method: .version_select at 0x7faaacb57af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-536662491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVsnRKU8XyC23gHBytjfBxX6M0MqjNH5ZI7Sm4md/xPjS7z/uF1kDXIndc2pP03JCzvNutAsSxV3eElfjWWFm3+pZMf8cJLG53aCso+/pxt0Kresof8VM+w+Z/KAd3EGg=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:35.635363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=12 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:35.635995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=24 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:35.647881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-97f586bc-19db-46ef-bd76-1f85dc1354a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Getting quotas for project 47196dc5cc824ce49dd5294fc59d50c4. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:19:35.651890 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-97f586bc-19db-46ef-bd76-1f85dc1354a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Getting quotas for user 1b9f88ab5ea341b8995aae4262ff041a and project 47196dc5cc824ce49dd5294fc59d50c4. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:19:35.676421 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-97f586bc-19db-46ef-bd76-1f85dc1354a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050808 Aug 17 20:19:35.677235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 489/1002] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:19:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:19:35.732067 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1937951645", "imageRef": "a68e436a-9bea-440c-a9bf-e21cae62291c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-536662491", "networks": [{"uuid": "1004bafb-2f72-44a3-997b-33bbef69a423"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:35.740745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:35.741377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:35.789223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] validate_networks() for [('1004bafb-2f72-44a3-997b-33bbef69a423', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:19:36.188421 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:19:36.188875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:19:36.189351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:19:36.189858 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:19:36.190270 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:19:36.199441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:36.199921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:36.200355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:36.201073 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:36.201569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:36.202014 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:36.218545 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Getting quotas for project 47196dc5cc824ce49dd5294fc59d50c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:19:36.222480 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Getting quotas for user 1b9f88ab5ea341b8995aae4262ff041a and project 47196dc5cc824ce49dd5294fc59d50c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:19:36.239489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:19:36.241738 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a68e436a-9bea-440c-a9bf-e21cae62291c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:19:36.288833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bb3d97dd-4cea-482f-ba91-2805131f2cfc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560685 Aug 17 20:19:36.289472 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 514/1003] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:19:36.300164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-553d5c86-4e94-4e93-8c40-df60ddf7535d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:36.300773 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-553d5c86-4e94-4e93-8c40-df60ddf7535d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:36.354390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-553d5c86-4e94-4e93-8c40-df60ddf7535d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:36.362061 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-553d5c86-4e94-4e93-8c40-df60ddf7535d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1258 microversion: 2.1 time: 0.065791 Aug 17 20:19:36.362617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 490/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:36 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:37.383323 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:37.384066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:37.391058 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:37.391639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:37.392077 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:37.392776 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:37.393224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:37.393670 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:37.461025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:37.470870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-07794629-3e0c-4600-b66c-49e47418a1e6 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1318 microversion: 2.1 time: 0.092033 Aug 17 20:19:37.484089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 515/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:37 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:38.495270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:38.495889 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:38.504556 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:38.505366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:38.505891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:38.511801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:38.512585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:38.513203 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:38.668673 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:38.676921 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4dfc5344-585a-46d1-b014-71dc5ad82eb0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.189426 Aug 17 20:19:38.680050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 491/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:38 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:39.700351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:39.701004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:39.707269 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:39.707753 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:39.708186 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:39.708881 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:39.709327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:39.709780 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:39.868732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:39.880285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3d9a9193-2e75-452a-9708-5d18a6a530cd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.181757 Aug 17 20:19:39.881345 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 516/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:39 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:40.901655 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:40.903096 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:40.909642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:40.910132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:40.910561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:40.911270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:40.911711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:40.912112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:41.049140 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:41.057320 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-067d719b-f8cd-4a62-b0ae-2f60081641c2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.159688 Aug 17 20:19:41.057928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 492/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:40 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:42.078615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:42.079239 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:42.086128 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:42.086611 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:42.087136 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:42.087933 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:42.088423 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:42.088864 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:42.233983 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:42.242049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-be78a732-7e97-4b81-9acf-7142358c822a tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.167409 Aug 17 20:19:42.242633 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 517/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:42 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:43.263366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:43.263991 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:43.270788 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:43.271267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:43.271691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:43.272383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:43.272824 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:43.273262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:43.439530 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:43.456800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e913c2c6-1ed0-493c-83a5-3f30327997ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.197378 Aug 17 20:19:43.457406 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 493/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:43 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:44.485530 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:44.487129 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:44.496356 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:44.496923 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:44.497489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:44.500448 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:44.501299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:44.502074 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:44.685138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:44.693355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-25ceacbb-cc44-41a1-be11-20ac1b33cee9 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.213290 Aug 17 20:19:44.693882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 518/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:44 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:45.718386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:45.719163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:45.726085 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:45.726546 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:45.726979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:45.727642 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:45.728092 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:45.728503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:45.874132 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:45.882060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-16467d57-ac0e-4381-a3a1-a282f68075e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.168188 Aug 17 20:19:45.882631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 494/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:45 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:46.905584 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:46.906305 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:46.908694 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:46.909380 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:46.916110 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:46.916621 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:46.917080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:46.917892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:46.918349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:46.918836 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:47.060416 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:47.069816 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-e6424269-4046-40d4-af5b-4419f941e9aa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.167996 Aug 17 20:19:47.070493 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 519/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:46 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:48.091282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:48.091908 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:48.093817 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:48.099915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:48.100390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:48.100819 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:48.101676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:48.102125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:48.102539 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:48.239613 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:48.247327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a742255b-1e25-459d-b68a-71037eaa43dd tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.160182 Aug 17 20:19:48.247935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 495/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:48 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:48.292990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:48.303622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:48.304718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:48.305363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:48.317207 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] Creating event network-changed:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:19:48.322198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-a457a8e9-321f-4e34-b629-fdd5ab3302d7 req-e2a8d063-5329-4f80-b817-af8ad276608a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033327 Aug 17 20:19:48.323079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 520/1015] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:49.272690 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:49.273654 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:49.284776 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:49.285608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:49.286330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:49.287452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:49.288193 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:49.288886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:49.435377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:49.445404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-08be90ef-6b30-49b2-b6b5-85f519a32e76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.179076 Aug 17 20:19:49.446270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 496/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:49 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:50.474540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:50.475672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:50.484011 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:50.484436 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:50.484893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:50.485571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:50.486057 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:50.486474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:50.627515 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:50.636654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5f1b1cce-1e60-42e5-beaa-e2f8e83bfa76 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.169849 Aug 17 20:19:50.637475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 521/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:50 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:51.662563 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:51.663182 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:51.670549 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:51.671031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:51.671461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:51.672158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:51.672605 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:51.673017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:51.812048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:51.819967 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5f4d447e-d066-4c70-807f-61edeccbc56b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.161341 Aug 17 20:19:51.820528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 497/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:51 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:52.845804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:52.846818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:52.856966 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:52.857975 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:52.858762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:52.860477 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:52.860787 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:52.861805 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:52.996915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:53.007523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-0ace3a32-83b8-4cef-b699-7e14a0475c3d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.168427 Aug 17 20:19:53.008430 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 522/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:52 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:53.408267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "name": "network-vif-plugged", "status": "completed", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:53.421204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:53.421707 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:53.422302 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:53.435637 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] Creating event network-vif-plugged:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:19:53.443466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-fd045b51-9541-44a0-8fdf-54a58c4b25d1 req-ab86ea79-75a2-46e0-b071-9acce8abcac0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038939 Aug 17 20:19:53.444097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 498/1020] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:54.029930 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:54.030524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:54.038212 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:54.038691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:54.039114 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:54.039818 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:54.040257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:54.040667 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:54.198066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:54.206103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f9a7a556-24de-4f6f-9c2f-c236c049114b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.181415 Aug 17 20:19:54.206710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 523/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:54 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:55.230074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:55.231262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:55.241405 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:55.242250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:55.243087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:55.244025 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:55.244466 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:55.244896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:55.388734 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:55.397751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-02e80e72-413e-422f-9e40-63ed3d62d28b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1358 microversion: 2.1 time: 0.173771 Aug 17 20:19:55.398325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 499/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:55 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:56.423257 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:56.423878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:56.431115 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:56.431590 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:56.432025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:56.432728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:56.433487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:56.433931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:56.587708 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:56.596981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9b457137-dd37-4ea9-82dd-8fa0af7eef0e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1547 microversion: 2.1 time: 0.177829 Aug 17 20:19:56.597594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 524/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:56 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:56.617899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:56.618653 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:56.625885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:56.626491 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:56.626988 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:56.627710 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:56.628562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:56.628562 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.104641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:57.112892 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a187e238-17bd-4b11-b5ea-ba2ce4e4754e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1547 microversion: 2.1 time: 0.499107 Aug 17 20:19:57.113836 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 500/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:56 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1547 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:57.141300 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:57.146211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:57.146990 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Searching by: {'deleted': False, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4'} {{(pid=120819) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 20:19:57.154076 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.154523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.156605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.157366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.157844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.158268 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.250029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.multi_cell_list [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 20:19:57.346386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-73bb57a1-1e65-4ee9-ad2d-63ae411b8db0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208886 Aug 17 20:19:57.347715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 525/1025] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Aug 17 20:19:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:57.358859 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:57.359477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:57.365986 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.366436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.366897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.367624 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.368054 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.368478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.623837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:57.632748 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-49ffa6f4-68f0-4360-9e4a-ecb7e32acb2f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1547 microversion: 2.1 time: 0.277994 Aug 17 20:19:57.635223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 501/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:57 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1547 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:57.906585 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:57.907675 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:57.915444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.916746 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.917831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.919195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:57.919863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:57.920569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:57.963111 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:19:58.085980 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-199d03b9-f0fb-4003-b411-4116a71e0045 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 204 len: 0 microversion: 2.1 time: 0.182287 Aug 17 20:19:58.087006 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 526/1027] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:19:57 2022] DELETE /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:19:58.098958 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:58.100059 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:58.108420 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:58.110275 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:58.110854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:58.111691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:58.112247 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:58.112903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:58.114681 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:58.125163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:58.125659 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:58.126082 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:58.138820 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] Creating event network-changed:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:19:58.144330 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-02153fd4-f0d2-49c0-aca8-3aa32550bf6f req-3cfb43dc-b714-46dd-b5bc-ef0397f25212 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212071 Aug 17 20:19:58.145282 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 502/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:58.252096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:58.260518 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ad06aad9-1f26-4d1a-b6ee-0362bc8ff03d tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.168715 Aug 17 20:19:58.261113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 527/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:58 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:19:59.235774 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b15fa18-57c2-4654-af35-1cc9c93fe85b"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:19:59.238279 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:59.245579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:59.246083 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:59.246514 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:59.247219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:59.247665 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:59.248051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:59.292568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:59.293773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:19:59.301009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:59.301502 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:59.301971 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:59.302682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:59.303164 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:59.303617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:59.449526 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:19:59.457765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-4062aed0-6e37-485b-9794-659079bae587 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1568 microversion: 2.1 time: 0.169349 Aug 17 20:19:59.458355 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 528/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:19:59 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:19:59.755407 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e472075a-0f6a-4f7a-ba6d-f720f847381b tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523838 Aug 17 20:19:59.756212 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 503/1031] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 17 20:19:59 2022] POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:20:00.484363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:20:00.485696 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:20:00.492714 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:00.493288 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:00.493834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:00.494775 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:00.495228 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:00.495768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:00.585939 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112f1de9bcdc4b8fb3d402190d4f0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458eee750aa741c493481ee785761172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:20:00.592494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:20:00.596893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf8959-7b18-4d3e-b97e-ed27a7a6329f", "name": "network-vif-deleted", "tag": "efef9f6d-d305-4bee-9c7a-753eb5690f32"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:20:00.599368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a2ae083e-265e-4319-b1a2-0a19a75d5d2e tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 200 len: 1381 microversion: 2.1 time: 0.123949 Aug 17 20:20:00.600384 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 529/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:20:00 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 1381 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:20:00.607780 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:00.608260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:00.608689 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:00.620610 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] Creating event network-vif-deleted:efef9f6d-d305-4bee-9c7a-753eb5690f32 for instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f on hv-cinder-82002 Aug 17 20:20:00.625827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-3f54b74a-4a67-4a59-9523-d4ea1cf68836 req-4aac669e-222a-4709-9686-d43db9355a19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Aug 17 20:20:00.626667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 504/1033] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:20:01.628291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:20:01.628291 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] [instance: 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:20:01.632637 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:01.633442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:01.634183 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:01.635029 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:01.635500 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:01.635905 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:01.652019 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] HTTP exception thrown: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Request method failure captured: Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f HTTP/1.1 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_UxBAkWL4MsxCR19wDtbN-xzjfvHQYjT86N5xPbbyDWhaV4DdLDsvHggk-ABXIntyBMuBGwprjfDdBYTGoQRz3xiNOIVnaBuGUsZHrSFVYiYEgmJ5vxdh64f1T1XvYsOif8jI2_ka7SEcH_XeipZjs3G0vMDQlqo60V2Cq8CJxQy45E Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 458eee750aa741c493481ee785761172 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestShelveInstance-1187700418 Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:20:01.653722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/458eee750aa741c493481ee785761172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_458eee750aa741c493481ee785761172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/458eee750aa741c493481ee785761172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/458eee750aa741c493481ee785761172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestShelveInstance-1187700418 Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 458eee750aa741c493481ee785761172 Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestShelveInstance-1187700418 Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestShelveInstance-1187700418-project Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 112f1de9bcdc4b8fb3d402190d4f0751 Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestShelveInstance-1187700418-project Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. Aug 17 20:20:01.656579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '7dbf8959-7b18-4d3e-b97e-ed27a7a6329f'} Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:20:01.658281 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. Aug 17 20:20:01.661167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:20:01.663803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Returning 404 to user: Instance 7dbf8959-7b18-4d3e-b97e-ed27a7a6329f could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:20:01.663803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c4e74831-b71a-45fb-8c72-3fb3ce534fe1 tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f" status: 404 len: 111 microversion: 2.1 time: 0.037499 Aug 17 20:20:01.663803 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 530/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:20:01 2022] GET /compute/v2.1/servers/7dbf8959-7b18-4d3e-b97e-ed27a7a6329f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:20:01.840925 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ccff418-031e-43d7-9827-ed1987bf57bd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] Calling method '.version_select at 0x7faaacb57040>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:20:01.869298 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ccff418-031e-43d7-9827-ed1987bf57bd tempest-TestShelveInstance-1187700418 tempest-TestShelveInstance-1187700418-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-595245363" status: 202 len: 0 microversion: 2.1 time: 0.036128 Aug 17 20:20:01.870507 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 505/1035] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 17 20:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-595245363 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:20:07.438955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:20:07.439593 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:20:07.442096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:20:07.442790 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:20:07.449773 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:07.450262 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:07.450856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:07.452050 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:07.452505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:07.452922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:07.591507 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:20:07.601250 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2a9f639d-7637-4f93-9f27-004406dc40ff tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1593 microversion: 2.1 time: 0.166130 Aug 17 20:20:07.602107 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 531/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:20:07 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:20:09.768767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:20:09.776760 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:20:09.788155 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:09.788667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:09.789097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:09.801853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:20:09.804348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] Creating event network-changed:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:20:09.811952 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-520a0402-4f2c-46f2-8635-9d5759c67edb req-6d80acae-f0ca-4288-9b9b-9744c873619b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048756 Aug 17 20:20:09.816250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 506/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:20:11.109485 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1413057088"}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:20:11.110564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:20:11.123390 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:11.124004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:11.124973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:11.126427 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:11.127304 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:11.127915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:11.266435 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.network.security_group_api [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Adding security group 825cc8ae-bd79-4c62-b06b-c8f9ad934fb9 to port 1f7e0bf9-9c79-4b61-9038-cb3781756ade Aug 17 20:20:11.636735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d0b14efc-10bd-4ff3-893b-4c4b78ff01e2 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action" status: 202 len: 0 microversion: 2.1 time: 0.537056 Aug 17 20:20:11.637349 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 532/1038] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:20:11 2022] POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:20:11.646794 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:20:11.647485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:20:11.655300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:11.655811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:11.656342 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:11.657031 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:11.657473 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:11.659112 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:11.810735 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:20:11.819196 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ad5dc69-aea3-44d3-a3b2-1f7573f05d1d tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1759 microversion: 2.1 time: 0.177150 Aug 17 20:20:11.833868 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 507/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:20:11 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:20:11.839094 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:20:11.848979 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:11.849451 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:11.849896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:11.862119 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] Creating event network-changed:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:20:11.867364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-f78e3f9f-e470-495e-9e1e-852e5678a1a1 req-340e830b-89ec-4ddf-b026-161380d05a4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032193 Aug 17 20:20:11.867962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 533/1040] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:12.339959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:12.341154 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=7 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:12.347612 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:12.351368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:12.360916 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:12.361391 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:12.361848 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:12.362531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:12.362973 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:12.363384 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:12.439377 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0a0d9992-1e69-47eb-8741-8aea91846a03 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action" status: 202 len: 0 microversion: 2.1 time: 0.102499 Aug 17 20:21:12.440008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 508/1041] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:21:12 2022] POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:21:12.446619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=5 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:12.447360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=14 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:12.452655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:12.453352 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:12.461140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:12.461647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:12.462080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:12.462765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:12.463210 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:12.463623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:12.618054 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:12.626402 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-586702cb-7c2a-498a-a49b-da069cbd57ac tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1751 microversion: 2.1 time: 0.181968 Aug 17 20:21:12.626991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 534/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:12 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:13.649820 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:13.650528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:13.658367 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:13.659448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:13.659881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:13.660568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:13.661012 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:13.661426 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:13.819837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:13.831146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1bfc77ea-3f5a-4cec-b8b2-50123521bef5 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.186501 Aug 17 20:21:13.831693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 509/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:13 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:14.854809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:14.855470 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:14.862615 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:14.863103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:14.863539 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:14.864256 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:14.864707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:14.865130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:15.027523 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:15.035987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-fe011908-01cd-4def-aceb-e434f2b931a3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.186328 Aug 17 20:21:15.036516 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 535/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:14 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:16.059288 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:16.059870 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:16.066797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:16.067277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:16.067705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:16.068437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:16.068810 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:16.069324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:16.215380 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:16.227113 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-055b41a7-c526-4c0c-b4b8-c36914d027bc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.172196 Aug 17 20:21:16.227847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 510/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:16 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:17.257725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:17.258429 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:17.265223 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:17.265741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:17.266169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:17.266862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:17.267316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:17.267734 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:17.415097 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:17.423943 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7da07a85-46b9-426d-ac8a-95d52e8ca909 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.170627 Aug 17 20:21:17.424538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 536/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:17 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:18.446030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:18.446704 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:18.454240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:18.454728 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:18.455123 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:18.455873 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:18.456325 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:18.456743 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:18.614608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:18.624427 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-73a3330f-f4c1-4a64-b989-12cdf318df10 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.182211 Aug 17 20:21:18.625008 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 511/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:18 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:19.645865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:19.646540 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:19.653900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:19.654394 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:19.654834 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:19.655657 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:19.656118 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:19.656669 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:19.815689 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:19.824525 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b5a19ac7-ae2f-4790-8aff-851be1a8adaf tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.182617 Aug 17 20:21:19.825142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 537/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:19 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:20.845870 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:20.846519 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:20.853364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:20.853872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:20.854295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:20.854998 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:20.855436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:20.855851 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:21.016879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:21.025668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-af2f3a17-4f74-4625-95e6-303164a5bc85 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.183781 Aug 17 20:21:21.026262 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 512/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:20 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:22.047679 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:22.048401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:22.055362 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:22.055846 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:22.056273 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:22.056959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:22.057406 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:22.057862 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:22.218576 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:22.228252 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9a2fb68a-ddb1-4c45-a524-8c6f50839353 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.184478 Aug 17 20:21:22.228891 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 538/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:22 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:23.250688 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:23.251301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:23.258756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:23.259257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:23.259683 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:23.260378 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:23.260827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:23.261241 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:23.420158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:23.428864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f5c20a98-695d-451b-874f-d891ff027f81 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.182133 Aug 17 20:21:23.429403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 513/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:23 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:23.990806 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:21:23.991068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:21:24.451405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:24.452041 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:24.459531 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:24.460000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:24.460426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:24.461113 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:24.461570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:24.462000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:24.621009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:24.630018 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9ad39ead-7e36-413d-8a9d-6c5a8f808d08 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.182656 Aug 17 20:21:24.630624 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 539/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:24 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:25.659858 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:25.660784 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:25.672169 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:25.673001 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:25.673767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:25.674893 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:25.675777 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:25.676197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:25.832299 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:25.841568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-60183c9b-f1b9-46c2-9b25-d7bf7a9786fa tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.190955 Aug 17 20:21:25.842311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 514/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:25 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:26.867830 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:26.868623 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:26.879367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:26.879850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:26.880272 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:26.880970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:26.881408 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:26.881831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:27.048088 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:27.057285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-f995e2d2-e699-43cd-9c30-a660a02ed820 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.195334 Aug 17 20:21:27.058003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 540/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:26 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:28.085427 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:28.086257 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:28.094758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:28.095355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:28.095895 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:28.096751 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:28.097311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:28.097876 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:28.257126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:28.270206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-effcb487-a0c7-4e66-9f06-0f421c5095f8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1756 microversion: 2.1 time: 0.189880 Aug 17 20:21:28.270968 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 515/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:28 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:29.297312 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:29.297921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:29.306111 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:29.306588 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:29.307013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:29.307720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:29.308166 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:29.308580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:29.465857 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:29.474775 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bd1d7901-a15d-497b-a23a-681ff7d2bfe0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1759 microversion: 2.1 time: 0.181423 Aug 17 20:21:29.475450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 541/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:29 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:32.811560 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=16 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:32.812693 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:32.817618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1413057088"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:32.818267 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:32.826222 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.826724 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.827188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.827896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.828348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.828765 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.979483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.network.security_group_api [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Removing security group 825cc8ae-bd79-4c62-b06b-c8f9ad934fb9 from port 1f7e0bf9-9c79-4b61-9038-cb3781756ade Aug 17 20:22:33.316885 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bcd1b69e-a1aa-4898-aa99-34e6a74f2de0 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action" status: 202 len: 0 microversion: 2.1 time: 0.507217 Aug 17 20:22:33.317498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 516/1057] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 17 20:22:32 2022] POST /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:22:33.325745 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=16 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:33.326963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=48 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:33.332515 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:33.363865 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:33.364656 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:33.365372 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:33.388592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] Creating event network-changed:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:22:33.396829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR oslo.messaging._drivers.impl_rabbit [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] [e24586b6-59df-42c5-bdde-a46997a9b1b7] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:22:34.410450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] [e24586b6-59df-42c5-bdde-a46997a9b1b7] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49032. Aug 17 20:22:34.415522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-b7b1b35e-2a3d-405d-9062-063db01301fe req-a10b8242-830c-42a7-8e38-63b5a94864f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.092152 Aug 17 20:22:34.416806 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 542/1058] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:22:34.921944 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:34.925635 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:34.935269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:34.937199 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:34.937914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:34.939637 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:34.940518 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:34.941284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.059452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lazy-loading 'services' on Instance uuid 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:22:35.128558 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:35.140867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.141664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.142292 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.156195 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] Creating event network-changed:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:22:35.170227 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-15b13fd2-0e94-432a-b593-002efffa0055 req-61e4fc62-6d55-4feb-8d68-971ec96d1bce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245594 Aug 17 20:22:35.171620 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 543/1059] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:35.189197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-13a75bc2-5589-49cc-a2df-9ee4b40b932f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments/6b15fa18-57c2-4654-af35-1cc9c93fe85b" status: 202 len: 0 microversion: 2.1 time: 0.274131 Aug 17 20:22:35.194404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 517/1060] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:22:34 2022] DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments/6b15fa18-57c2-4654-af35-1cc9c93fe85b => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:22:35.201410 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:35.204311 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:35.212840 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.214140 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.215169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.216850 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.217687 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.218285 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.278940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-66d50f96-a7e8-4c99-b6fd-52dec17a6b9e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081545 Aug 17 20:22:35.279613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 544/1061] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:22:35 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:36.301429 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:36.305014 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:36.314955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.315631 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.316293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.317245 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.318118 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.318761 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.353979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b1227a4b-eb96-481e-b3a6-d25d006a6777 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062180 Aug 17 20:22:36.354561 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 518/1062] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 17 20:22:36 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:22:36.366214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:36.366900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:36.374397 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.374879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.375309 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.376025 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.376469 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.376900 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.482334 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] HTTP exception thrown: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 is not attached to volume 6b15fa18-57c2-4654-af35-1cc9c93fe85b Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Request method failure captured: Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments/6b15fa18-57c2-4654-af35-1cc9c93fe85b HTTP/1.1 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_U1JkZBGJn5-DOtxWnvNveHkwMJugCWenwgTpZVMEyKLGsSTsgAaAsZxgQYB9qlF6A5GTk67TFpwZvWS7yyUUyEdBx1LrUkKrLJbXd8QOrfIw4zWqKxbXOQOUMLfQCeW6mSUeOTn5HwWtTHh59ScBJi870y8NnvAeJbzV8G1P5C2H4w Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 47196dc5cc824ce49dd5294fc59d50c4 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:22:36.484869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 47196dc5cc824ce49dd5294fc59d50c4 Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestMinimumBasicScenario-713184427-project Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1b9f88ab5ea341b8995aae4262ff041a Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestMinimumBasicScenario-713184427-project Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:22:36.487571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 is not attached to volume 6b15fa18-57c2-4654-af35-1cc9c93fe85b Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'server_id': '2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042', 'id': '6b15fa18-57c2-4654-af35-1cc9c93fe85b'} Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6b15fa18-57c2-4654-af35-1cc9c93fe85b. Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:36.488842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 is not attached to volume 6b15fa18-57c2-4654-af35-1cc9c93fe85b Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 is not attached to volume 6b15fa18-57c2-4654-af35-1cc9c93fe85b Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:36.490783 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Returning 404 to user: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 is not attached to volume 6b15fa18-57c2-4654-af35-1cc9c93fe85b {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:36.492573 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d0e3fd96-f5e3-46ca-9471-b40f8fddb0dc tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments/6b15fa18-57c2-4654-af35-1cc9c93fe85b" status: 404 len: 154 microversion: 2.1 time: 0.124663 Aug 17 20:22:36.492573 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 545/1063] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 17 20:22:36 2022] DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042/os-volume_attachments/6b15fa18-57c2-4654-af35-1cc9c93fe85b => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:22:37.670192 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:37.671213 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:37.678437 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.678922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.679361 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.680068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.680521 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.681311 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.711176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:22:37.817146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3aa34b7a-346f-4d55-b258-87c0240fdc5e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 204 len: 0 microversion: 2.1 time: 0.153555 Aug 17 20:22:37.818260 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 519/1064] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:22:37 2022] DELETE /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:22:37.831405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:37.832489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:37.843553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.844225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.844926 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.846121 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.846909 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.847639 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.999461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:38.008176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6fc6b5a5-0e03-4dbf-aa8b-6ddc4d7477e3 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1553 microversion: 2.1 time: 0.184306 Aug 17 20:22:38.008764 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 546/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:37 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:39.034491 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:39.035408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:39.049043 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.049729 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.050276 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.051102 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.051720 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.052249 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.199364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:39.207428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b1b5c25b-c2d0-4ba4-9c39-2ae844908a89 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1553 microversion: 2.1 time: 0.178424 Aug 17 20:22:39.208007 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 520/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:39 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:40.233135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:40.233739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:40.244225 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:40.245768 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:40.246265 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:40.247151 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:40.247581 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:40.248004 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:40.328442 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9f88ab5ea341b8995aae4262ff041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47196dc5cc824ce49dd5294fc59d50c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:40.336655 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-bdb7c7aa-ac0b-4edc-b3db-23d34a2e107e tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 200 len: 1511 microversion: 2.1 time: 0.107777 Aug 17 20:22:40.337214 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 547/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:40 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 1511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:40.348706 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042", "name": "network-vif-deleted", "tag": "1f7e0bf9-9c79-4b61-9038-cb3781756ade"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:40.368963 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:40.370368 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:40.371148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:40.384457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] Creating event network-vif-deleted:1f7e0bf9-9c79-4b61-9038-cb3781756ade for instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 on hv-cinder-82002 Aug 17 20:22:40.392317 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-cbb3f9b5-fd04-4e11-b560-27c9a59d0391 req-95c0a4aa-f81a-4f97-a917-b70318fcebbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048374 Aug 17 20:22:40.393461 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 521/1068] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:41.359620 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:41.360577 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [instance: 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:41.367659 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.368148 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.368580 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.369318 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.369784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.370215 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.386441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] HTTP exception thrown: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Request method failure captured: Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 HTTP/1.1 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_U1JkZBGJn5-DOtxWnvNveHkwMJugCWenwgTpZVMEyKLGsSTsgAaAsZxgQYB9qlF6A5GTk67TFpwZvWS7yyUUyEdBx1LrUkKrLJbXd8QOrfIw4zWqKxbXOQOUMLfQCeW6mSUeOTn5HwWtTHh59ScBJi870y8NnvAeJbzV8G1P5C2H4w Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: 47196dc5cc824ce49dd5294fc59d50c4 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:22:41.388009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47196dc5cc824ce49dd5294fc59d50c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: 47196dc5cc824ce49dd5294fc59d50c4 Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestMinimumBasicScenario-713184427 Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestMinimumBasicScenario-713184427-project Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: 1b9f88ab5ea341b8995aae4262ff041a Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestMinimumBasicScenario-713184427-project Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. Aug 17 20:22:41.390157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042'} Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:41.391367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. Aug 17 20:22:41.392932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.394924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Returning 404 to user: Instance 2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:41.394924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-24eb1d0c-02e3-4b81-bb5e-e338eac72ad8 tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042" status: 404 len: 111 microversion: 2.1 time: 0.035042 Aug 17 20:22:41.394924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 548/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:41 2022] GET /compute/v2.1/servers/2e5a8fa2-c792-4bd1-8b39-f7d1dbcaf042 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:41.403957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f86e5dab-20b0-4057-bfcb-0607ce641f9f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] Calling method '.version_select at 0x7faaacfc1280>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:41.411047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f86e5dab-20b0-4057-bfcb-0607ce641f9f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:22:42.419051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [None req-f86e5dab-20b0-4057-bfcb-0607ce641f9f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49076. Aug 17 20:22:42.443204 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f86e5dab-20b0-4057-bfcb-0607ce641f9f tempest-TestMinimumBasicScenario-713184427 tempest-TestMinimumBasicScenario-713184427-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-536662491" status: 202 len: 0 microversion: 2.1 time: 1.046265 Aug 17 20:22:42.443922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 522/1070] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Aug 17 20:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-536662491 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:23:03.137382 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=14 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:03.138095 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=30 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:03.413825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-893d1513-e5c8-4800-b7c0-5d5fe80a5570 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Action: 'create', calling method: .version_select at 0x7faaad474b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-194102395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm+GvG6+AkUBNNYyoRPO9GaBFvSYlybWikMWuZ1JiUEg4BWJwW6HHlJaH247dHcjB+AfZ1qglBeQ1lQb8YddsdQNtF260s1PvNeswWJx5EoAuplbQj3outJY0l5vW7cFQ=="}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:03.433400 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-893d1513-e5c8-4800-b7c0-5d5fe80a5570 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:03.439547 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-893d1513-e5c8-4800-b7c0-5d5fe80a5570 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for user e0240700f55f4376a51483fd0f15dd48 and project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'key_pairs'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:03.472718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-893d1513-e5c8-4800-b7c0-5d5fe80a5570 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.340362 Aug 17 20:23:03.473885 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 549/1071] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 17 20:23:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:25.878021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:25.878745 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:25.883519 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-711299213", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-194102395", "security_groups": [{"name": "tempest-secgroup-smoke-1114312362"}], "block_device_mapping_v2": [{"uuid": "f77270ae-4007-4614-9daa-61bcc50c71cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "193b96fc-948c-43ea-a020-3e48466f8e3a"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:26.128044 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] validate_networks() for [('193b96fc-948c-43ea-a020-3e48466f8e3a', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:26.612964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:26.613433 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:26.613946 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:26.614355 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:26.614767 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:26.623768 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:26.624239 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:26.624668 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:26.625517 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:26.625993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:26.626414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:26.644087 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:26.648261 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for user e0240700f55f4376a51483fd0f15dd48 and project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:26.705591 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:26.707791 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f77270ae-4007-4614-9daa-61bcc50c71cb',volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:26.850390 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5fddc2fa-346e-4127-a77f-60e5b56adf29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973674 Aug 17 20:23:26.851036 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 523/1072] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:23:26.861244 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=4 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:26.862286 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:26.870638 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-d6f602be-c2a8-4615-a275-51dd5ba363dc tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:26.871823 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-d6f602be-c2a8-4615-a275-51dd5ba363dc tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:27.001327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-d6f602be-c2a8-4615-a275-51dd5ba363dc tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:27.008798 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-d6f602be-c2a8-4615-a275-51dd5ba363dc tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1093 microversion: 2.1 time: 0.149295 Aug 17 20:23:27.009610 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 550/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:26 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1093 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:28.032726 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:28.033834 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:28.041801 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:28.042274 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:28.042702 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:28.043385 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:28.043828 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:28.044240 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:28.129891 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.138383 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-75d32f00-7a99-4ddb-abb2-ed742c3c3784 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1199 microversion: 2.1 time: 0.112071 Aug 17 20:23:28.139345 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 524/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:28 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:29.169658 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:29.170551 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:29.182170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.183713 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.184592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.186032 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.187003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.187929 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.384447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:29.394722 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-b39572ea-6c85-4caa-ac58-6cd0e44a8237 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.231186 Aug 17 20:23:29.395663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 551/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:29 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:29.687259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e372d84-2817-4bab-863a-b9ee8741f825", "tag": "128a232c-f53e-44be-9cb7-0ef48e72ab87"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:29.699695 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.700176 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.700866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.724764 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] Creating event network-changed:128a232c-f53e-44be-9cb7-0ef48e72ab87 for instance 1e372d84-2817-4bab-863a-b9ee8741f825 on hv-cinder-82002 Aug 17 20:23:29.735248 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-6c3b4664-2026-443a-b59d-056d76b7413e req-e4b99b37-a425-4def-bf1b-f54f5835ba89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052184 Aug 17 20:23:29.736247 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 525/1076] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:30.423444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:30.424484 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:30.436162 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.436892 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.437711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.438967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.439784 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.440529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.607739 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:30.615955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-79b5db6b-0c98-4622-9329-8d143d32cc8f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.199107 Aug 17 20:23:30.616546 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 552/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:30 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:31.643065 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:31.644308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:31.654667 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:31.655457 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:31.656194 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:31.657082 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:31.657566 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:31.658221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:31.810945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.823189 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-72a6f1d9-b6de-402e-977e-bae185384487 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.189386 Aug 17 20:23:31.823802 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 526/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:31 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:32.855360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:32.855977 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:32.862766 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.863248 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.864869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:32.865614 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.866069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.866496 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:33.025405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:33.035062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ab262a76-73bf-4105-800e-8e5bbb46bbad tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.183486 Aug 17 20:23:33.035804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 553/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:32 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:34.058936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:34.059756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:34.066839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:34.067328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:34.067763 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:34.068472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:34.068928 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:34.069349 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:34.218614 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:34.226713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa6aec57-79ca-49c9-8b6c-6d19c335b244 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.172081 Aug 17 20:23:34.227285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 527/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:34 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:35.248198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:35.248848 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:35.256698 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.257177 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.257635 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.258330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.258770 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.259185 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.427522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:35.436237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-eea18fd9-50dd-4abb-95ad-26837707a7e0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.192239 Aug 17 20:23:35.436815 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 554/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:35 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:36.458766 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:36.459579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:36.465864 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.466348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.466778 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:36.467481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.467983 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.468404 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:36.629838 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:36.635188 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:36.643104 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-589018a6-e9cb-4fbb-9151-8cf011bb0f3e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.189329 Aug 17 20:23:36.644103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 528/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:36 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:37.672981 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:37.673894 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:37.676758 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:37.683007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:37.683490 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:37.683895 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:37.684622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:37.685047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:37.685517 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:37.826237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:37.834809 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-6db982f0-89ce-4686-8c59-9d51675473e4 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.166033 Aug 17 20:23:37.835388 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 555/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:37 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:38.855685 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:38.856474 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:38.858388 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:38.864933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.865392 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.865856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:38.866554 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.866994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.867431 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:39.009564 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:39.017506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ecf85614-ab7f-47e1-b6df-907dd1f2b702 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.165712 Aug 17 20:23:39.018103 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 529/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:38 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:40.042778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:40.043825 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:40.054685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.055183 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.055619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.056689 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.057142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.057595 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.202508 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:40.210505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-1f26f1da-a7ac-4c20-9f09-a9b92515b90d tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.173735 Aug 17 20:23:40.211080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 556/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:40 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:40.632374 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e372d84-2817-4bab-863a-b9ee8741f825", "name": "network-vif-plugged", "status": "completed", "tag": "128a232c-f53e-44be-9cb7-0ef48e72ab87"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:40.642526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.642917 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.643993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.657557 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] Creating event network-vif-plugged:128a232c-f53e-44be-9cb7-0ef48e72ab87 for instance 1e372d84-2817-4bab-863a-b9ee8741f825 on hv-cinder-82002 Aug 17 20:23:40.662995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a61100ac-c943-40fb-88d6-48ccf70be2b8 req-0e495164-6440-4b26-aba5-bed6277a3a0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098988 Aug 17 20:23:40.663692 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 530/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:41.231867 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:41.232545 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:41.239878 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:41.240460 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:41.240960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:41.241762 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:41.242209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:41.242628 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:41.382153 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:41.390997 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-08386656-96bf-40f7-a5c8-de63182f7332 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.163320 Aug 17 20:23:41.391683 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 557/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:41 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:42.414626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:42.415343 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:42.423935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.424413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.424837 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.425531 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.426000 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.426452 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.582447 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.598540 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b6aed1e6-02b5-46a3-91f5-d1832e9428ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1265 microversion: 2.1 time: 0.190462 Aug 17 20:23:42.599269 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 531/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:42 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:43.627045 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:43.628117 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:43.636801 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.637299 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.637765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.638489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.638963 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.639391 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.810553 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:43.819168 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-330c835a-f8dc-41b9-88cc-8db0bc0667f6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1451 microversion: 2.1 time: 0.198155 Aug 17 20:23:43.819785 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 558/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:43 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1451 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:43.842304 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:43.843197 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:43.850028 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.850526 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.850964 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.851682 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.852137 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.852558 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:44.014899 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.024676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9484721f-0f5a-4434-b7c7-169052b437c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1451 microversion: 2.1 time: 0.186130 Aug 17 20:23:44.025256 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 532/1090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:43 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1451 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:45.850138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e372d84-2817-4bab-863a-b9ee8741f825", "tag": "128a232c-f53e-44be-9cb7-0ef48e72ab87"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:45.860852 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.861903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.861903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.874522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] Creating event network-changed:128a232c-f53e-44be-9cb7-0ef48e72ab87 for instance 1e372d84-2817-4bab-863a-b9ee8741f825 on hv-cinder-82002 Aug 17 20:23:45.879546 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-1d8930e0-0655-449a-8fbc-669345d2b6ec req-86455415-42d4-4e31-8bbe-0ad06d739b59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033084 Aug 17 20:23:45.880138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 559/1091] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:41.467701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:24:41.468505 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:24:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:25:52.450672 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:25:52.451379 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:25:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:26:00.181700 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:00.182805 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=48 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:00.187653 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:00.188167 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:00.194993 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.195481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.195915 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.196617 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.197070 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.197490 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.225131 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:26:00.309888 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d6f3814-50bb-47b0-99b0-6cb9e4faf97e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 204 len: 0 microversion: 2.1 time: 0.129849 Aug 17 20:26:00.310506 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 533/1092] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:26:00 2022] DELETE /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:26:00.317700 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [060a82ef-cc4b-49ce-b729-3727fa37dc8a] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 20:26:00.318347 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=22 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:00.319089 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=50 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:00.323707 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:00.324395 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:00.332238 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.332718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.333144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.333871 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.334328 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.334741 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.481447 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.489856 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-09e764a5-960b-487f-b50c-3c52df41eb54 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1575 microversion: 2.1 time: 0.174071 Aug 17 20:26:00.490469 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 560/1093] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:00 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:01.512093 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:01.512737 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:01.519906 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.520386 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.520812 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.521512 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.521979 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.522397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.666164 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:01.674363 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-40630f2f-ce66-43e6-af36-03b173cfbf67 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1575 microversion: 2.1 time: 0.166779 Aug 17 20:26:01.674945 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 534/1094] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:01 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:02.699401 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:02.700370 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:02.710010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.710606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.711324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.712445 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.713007 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.713571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.721692 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] [060a82ef-cc4b-49ce-b729-3727fa37dc8a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49468. Aug 17 20:26:02.794466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.803740 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-039d7c06-8173-4e7b-87ca-361b8a2eb501 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1507 microversion: 2.1 time: 0.110866 Aug 17 20:26:02.804781 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 561/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:02 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1507 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:03.124785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e372d84-2817-4bab-863a-b9ee8741f825", "name": "network-vif-deleted", "tag": "128a232c-f53e-44be-9cb7-0ef48e72ab87"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:03.152187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.152187 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.152627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.167922 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] Creating event network-vif-deleted:128a232c-f53e-44be-9cb7-0ef48e72ab87 for instance 1e372d84-2817-4bab-863a-b9ee8741f825 on hv-cinder-82002 Aug 17 20:26:03.176393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c5bddf2e-b0c3-4320-b8f9-8a8644c5a36d req-903c7130-9d53-46d2-80dc-4a88c0f4de1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055618 Aug 17 20:26:03.177400 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 535/1096] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:03.828080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:03.828951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:03.839053 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.839434 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.839965 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.840552 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.841069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.841492 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.875579 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.876142 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.876570 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.877021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.objects.instance [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lazy-loading 'fault' on Instance uuid 1e372d84-2817-4bab-863a-b9ee8741f825 {{(pid=120819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:26:03.927504 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:03.938702 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9fb6e35b-85ed-450f-9e09-1469771e77ec tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 200 len: 1229 microversion: 2.1 time: 0.115640 Aug 17 20:26:03.939310 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 562/1097] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:03 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:04.960856 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:04.961675 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:04.968442 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.968952 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.969373 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.970245 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.970686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.971246 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.985163 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] HTTP exception thrown: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Request method failure captured: Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 HTTP/1.1 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_U4huvmJ16Uc8gUfV-_6-HHJ4cryTlF1N1LTDNc9Au2ph6GHrDcC7nd5FB6q5Lz4i_pBJMbjweyC3oeTla-IL5LywfYqx3Tl0RRRphUoy42pD0YUcTZQvFf1_WR_bvzdfdCXn-dNMwiPuWbCe-D_HVXzDXls0f8Peb0T67uFwd_fSbo Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:26:04.986881 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: e0240700f55f4376a51483fd0f15dd48 Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:26:04.988775 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '1e372d84-2817-4bab-863a-b9ee8741f825'} Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:26:04.989787 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:26:04.991259 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:26:04.993295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Returning 404 to user: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:26:04.993295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-be578822-b0eb-4b0b-97f1-752dac6e9cd8 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 404 len: 111 microversion: 2.1 time: 0.031907 Aug 17 20:26:04.993295 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 536/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:04 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:05.047704 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1412653645", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-194102395", "security_groups": [{"name": "tempest-secgroup-smoke-1114312362"}], "block_device_mapping_v2": [{"uuid": "f77270ae-4007-4614-9daa-61bcc50c71cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "193b96fc-948c-43ea-a020-3e48466f8e3a"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:05.164985 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] validate_networks() for [('193b96fc-948c-43ea-a020-3e48466f8e3a', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:26:05.860701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:26:05.861360 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:26:05.862080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:26:05.862591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:26:05.863096 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:26:05.872851 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.873333 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.873804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.874524 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.874969 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.875386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.892571 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:26:05.896728 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for user e0240700f55f4376a51483fd0f15dd48 and project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:26:05.958080 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:26:05.960392 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f77270ae-4007-4614-9daa-61bcc50c71cb',volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:26:06.102617 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-38edae07-3d76-4a69-ae7b-b7732aaeb1d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062275 Aug 17 20:26:06.103333 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 563/1099] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:26:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:26:06.115004 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3cb1a71e-d11b-44e1-a7d9-797f2e0424ee tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:06.115627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3cb1a71e-d11b-44e1-a7d9-797f2e0424ee tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:06.173277 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3cb1a71e-d11b-44e1-a7d9-797f2e0424ee tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.181756 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3cb1a71e-d11b-44e1-a7d9-797f2e0424ee tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1094 microversion: 2.1 time: 0.070879 Aug 17 20:26:06.183106 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 537/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:06 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:07.204960 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:07.206383 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:07.214955 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.215437 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.215866 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.216563 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.217010 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.217426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.303047 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:07.313144 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-8e8656fa-5064-43fb-9061-716c68daea70 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1200 microversion: 2.1 time: 0.112469 Aug 17 20:26:07.320027 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 564/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:07 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:08.336926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:08.337582 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:08.348608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.349097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.349553 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.350305 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.350754 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.351173 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.511886 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:08.521217 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2a21728c-4bee-4bbc-a8a7-632ee016b7f7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.189937 Aug 17 20:26:08.521875 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 538/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:08 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:08.758992 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6421ee2-8c5d-49eb-b13c-d5d8660c112c", "tag": "398b46fe-edc0-4c7f-bf1a-63a4792947ea"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:08.772479 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.772984 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.773951 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.786934 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] Creating event network-changed:398b46fe-edc0-4c7f-bf1a-63a4792947ea for instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c on hv-cinder-82002 Aug 17 20:26:08.793832 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-b7531484-b046-450f-91ba-b44eab2ca8ce req-f7f16e7b-08d2-418b-94dc-87bca03edaaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040247 Aug 17 20:26:08.794441 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 565/1103] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:09.542985 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:09.543608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:09.550823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:09.551308 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:09.551742 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.552430 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:09.552871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:09.553299 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.690450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:09.698170 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-81c6c09f-3241-42ae-8410-fa7e436bc892 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.159191 Aug 17 20:26:09.698742 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 539/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:09 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:10.722765 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:10.723366 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:10.730237 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.730720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.731170 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.731870 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.732324 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.732735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.872839 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:10.882070 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c53e981a-919d-4224-8f53-ec3cf80dd6d0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.165793 Aug 17 20:26:10.882735 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 566/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:10 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:11.903907 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:11.904527 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:11.911348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.911839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.912266 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.912953 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.913396 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.913849 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:12.051157 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:12.059263 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d6813f0-c7ab-4a3e-9f8c-2c8f022871d5 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.159378 Aug 17 20:26:12.059845 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 540/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:11 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:13.080557 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:13.081135 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:13.087962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.088444 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.088874 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:13.089605 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.090069 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.090503 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:13.242653 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:13.250884 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-a8ecccfa-2d23-41e8-8641-1119dd4b232c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.174414 Aug 17 20:26:13.251474 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 567/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:13 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:14.272477 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:14.273146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:14.279965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.280436 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.280860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.281579 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.282047 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.282472 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.429081 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:14.439037 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6807ece4-2c1b-4515-b289-ea814055d16e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.170408 Aug 17 20:26:14.439626 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 541/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:14 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:15.460146 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:15.460967 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:15.468062 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.468594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.469078 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.469924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.470414 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.470869 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.615453 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:15.623346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-3e29e0ca-d526-4385-9250-d31c89419b23 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.167081 Aug 17 20:26:15.623896 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 568/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:15 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:16.644420 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:16.645057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:16.647435 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:16.653328 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.653847 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.654278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.654969 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.655413 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.655827 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.804179 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:16.817397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a76c7531-e61b-41a4-8358-6d9daf035d21 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.176498 Aug 17 20:26:16.818454 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 542/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:16 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:17.839038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:17.839619 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:17.841665 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:17.842330 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:17.849079 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:17.849487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:17.849941 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:17.850644 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:17.851084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:17.851494 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:18.014064 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:18.026224 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ae079ddf-1cf4-4e71-9820-3ec4f6aecd55 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.190854 Aug 17 20:26:18.027120 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 569/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:17 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:19.049319 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:19.049970 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:19.057099 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.057580 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.058356 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.059221 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.059666 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.060084 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.231687 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:19.250270 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ba9817a3-6888-422f-8107-824efe509a24 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.204781 Aug 17 20:26:19.251074 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:19 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:19.313710 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6421ee2-8c5d-49eb-b13c-d5d8660c112c", "name": "network-vif-plugged", "status": "completed", "tag": "398b46fe-edc0-4c7f-bf1a-63a4792947ea"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:19.323754 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.324222 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.324630 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.339321 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] Creating event network-vif-plugged:398b46fe-edc0-4c7f-bf1a-63a4792947ea for instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c on hv-cinder-82002 Aug 17 20:26:19.345016 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-8c76b88b-02ad-4c3c-93ac-fad8cea88b06 req-298c0389-0a82-47d0-855a-62ce440d2128 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Aug 17 20:26:19.345341 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 570/1113] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:20.272348 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:20.272913 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:20.279705 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.280250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.280680 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.281398 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.281920 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.282340 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.434278 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:20.447611 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7201a6a3-f6b1-4552-b253-0b762dbdaac1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.179072 Aug 17 20:26:20.448596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 544/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:20 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:21.484138 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:21.485332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:21.495022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:21.495810 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:21.496554 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:21.497814 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:21.498608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:21.499343 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:21.688386 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:21.702998 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-46afcb92-38f6-45a0-aefe-29f217abbd9f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1266 microversion: 2.1 time: 0.225778 Aug 17 20:26:21.704194 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 571/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:21 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:22.726485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:22.727381 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:22.734476 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:22.735067 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:22.735550 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:22.736300 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:22.736823 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:22.737293 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:22.893897 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:22.902235 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-627ae89a-16cd-4a89-98de-4fa87ff16139 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1453 microversion: 2.1 time: 0.179606 Aug 17 20:26:22.902811 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 545/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:22 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:22.925932 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:22.926937 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:22.937844 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:22.938578 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:22.939255 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:22.940112 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:22.940606 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:22.941378 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:23.125921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:23.134389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2ca5d842-35aa-4dc1-9d9b-5f2403dec5d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1453 microversion: 2.1 time: 0.215035 Aug 17 20:26:23.135012 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 572/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:22 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:24.002505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:26:24.002505 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:26:25.042585 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6421ee2-8c5d-49eb-b13c-d5d8660c112c", "tag": "398b46fe-edc0-4c7f-bf1a-63a4792947ea"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:25.052958 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:25.053485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:25.054111 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:25.067216 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] Creating event network-changed:398b46fe-edc0-4c7f-bf1a-63a4792947ea for instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c on hv-cinder-82002 Aug 17 20:26:25.072839 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-34fd3268-59cf-4c39-a79a-6a0d4c9d871a req-26690214-a5ea-4148-9142-bc057d53c0c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098742 Aug 17 20:26:25.073615 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 546/1118] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:27:53.143412 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:27:53.144186 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:28:23.212915 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:23.213685 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=68 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:23.218083 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1598041233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-194102395", "security_groups": [{"name": "tempest-secgroup-smoke-1114312362"}], "block_device_mapping_v2": [{"uuid": "2d784f19-f411-4c5b-b8d4-55f6b143539e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "193b96fc-948c-43ea-a020-3e48466f8e3a"}]}} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:23.340139 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.network.neutron [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] validate_networks() for [('193b96fc-948c-43ea-a020-3e48466f8e3a', None, None, None, None, None)] {{(pid=120819) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:28:23.746775 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:28:23.747178 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image limits 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:28:23.747654 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Flavor pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:28:23.748048 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Image pref 0:0:0 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:28:23.748450 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.virt.hardware [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:28:23.757699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.758169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.758591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.759326 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.759763 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.760169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.782433 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:28:23.793099 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.quota [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Getting quotas for user e0240700f55f4376a51483fd0f15dd48 and project e7ecb49247654d5f92cf32c4fbb01845. Resources: {'instances', 'cores', 'ram'} {{(pid=120819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:28:23.853487 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Going to run 1 instances... {{(pid=120819) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:28:23.855642 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d784f19-f411-4c5b-b8d4-55f6b143539e',volume_size=None,volume_type=None)] {{(pid=120819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:28:23.998682 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7cdcae60-efca-4af8-ad4b-d917e18689ba tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787442 Aug 17 20:28:23.999721 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 573/1119] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 17 20:28:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:28:24.008975 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e05548b-374a-499d-93a8-504220fce716] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:28:24.009930 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:24.010387 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:24.015146 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2c86f08-5bcd-4f51-99cb-7e6544b0d98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:24.015853 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2c86f08-5bcd-4f51-99cb-7e6544b0d98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:24.076679 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d2c86f08-5bcd-4f51-99cb-7e6544b0d98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:24.085301 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2c86f08-5bcd-4f51-99cb-7e6544b0d98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1094 microversion: 2.1 time: 0.078193 Aug 17 20:28:24.086017 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 547/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:24 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:25.115854 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:25.116916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:25.124974 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:25.125466 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:25.126157 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:25.126879 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:25.127405 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:25.127829 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:25.199922 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:25.210336 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-356c9fb7-baa1-4e1a-be89-bd99930395c1 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1200 microversion: 2.1 time: 0.100543 Aug 17 20:28:25.211346 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 574/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:25 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:26.233414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:26.234757 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:26.243797 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.244290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.244698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.245620 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.246051 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.246478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.252464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e05548b-374a-499d-93a8-504220fce716] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49664. Aug 17 20:28:26.436758 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:26.444563 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b600a463-1c58-4376-b748-ee3524ae64bf tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.215599 Aug 17 20:28:26.445321 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 548/1122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:26 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:26.725003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ed38e-01d0-4849-89c1-1abbf92bdc7e", "tag": "8fdbc168-d686-45a5-8cf6-f017a6c83589"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:26.744526 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.745916 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.746406 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.758711 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] Creating event network-changed:8fdbc168-d686-45a5-8cf6-f017a6c83589 for instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e on hv-cinder-82002 Aug 17 20:28:26.764009 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-bc79788a-df6c-4c9f-8c9d-a9033ea64019 req-b9dc133c-5d61-480c-9467-b02baee5896c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105151 Aug 17 20:28:26.764660 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 575/1123] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:27.465792 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:27.466397 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:27.473393 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.473900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.474339 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.475048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.475498 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.475918 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.616201 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:27.624896 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6edec691-05a4-4d93-9a3d-468aea05fd98 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.163246 Aug 17 20:28:27.625450 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 549/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:27 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:28.654902 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:28.655748 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:28.662282 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.662761 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.663188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:28.663888 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.664332 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.664743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:29.100461 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:29.110389 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2c106a2e-ed26-449c-876a-c56d8154b84a tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.460744 Aug 17 20:28:29.110991 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 576/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:28 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:30.132198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:30.133021 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:30.140002 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:30.140481 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:30.140905 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.141608 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:30.142050 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:30.142489 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.284004 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:30.292923 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8cb164ce-4a46-4e69-b757-31713ffe5303 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.164495 Aug 17 20:28:30.293528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 550/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:30 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:31.314705 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:31.315350 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:31.322266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:31.322743 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:31.323143 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:31.323893 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:31.324377 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:31.324788 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:31.469882 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:31.483778 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ff165cfe-053f-4b46-b66f-73de953bc370 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.172990 Aug 17 20:28:31.484364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 577/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:31 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:32.506032 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:32.506650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:32.513790 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.514290 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.514714 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.515401 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.515843 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.516255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.663523 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:32.675048 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8bb06b79-ff5c-4a12-b8fd-33e7a18f2c59 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.173261 Aug 17 20:28:32.675655 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 551/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:32 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:33.697196 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:33.697886 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:33.704198 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:33.704678 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:33.705098 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:33.705924 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:33.706363 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:33.706771 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:33.767903 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=2 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:33.805529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell0:SELECT=6 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:33.864663 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:33.872727 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-52134b4d-1dcb-4d96-a3c2-dafabcf8b98f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.179427 Aug 17 20:28:33.873169 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 578/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:33 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:34.894602 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:34.895568 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:34.898340 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:34.904366 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:34.904871 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:34.905310 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:34.906030 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:34.906483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:34.906909 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.060879 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:35.070027 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a890c587-2add-4369-9817-484b6e7422aa tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.179305 Aug 17 20:28:35.070669 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 552/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:34 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:36.099411 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:36.100022 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:36.107092 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:36.107590 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:36.108038 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:36.108780 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:36.109187 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:36.109622 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:36.271907 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:36.279973 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ade38997-a7ed-4523-aa4f-3b36334f5603 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.184686 Aug 17 20:28:36.280536 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 579/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:36 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:37.301503 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:37.302285 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:37.309604 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.310098 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.310533 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.311250 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.311719 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.312166 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.461418 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:37.469403 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b18dd40c-7cb8-4700-b44b-7a9ce0938374 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.171856 Aug 17 20:28:37.470089 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 553/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:37 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:38.064005 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ed38e-01d0-4849-89c1-1abbf92bdc7e", "name": "network-vif-plugged", "status": "completed", "tag": "8fdbc168-d686-45a5-8cf6-f017a6c83589"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:38.074913 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.076066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.076066 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.087400 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] Creating event network-vif-plugged:8fdbc168-d686-45a5-8cf6-f017a6c83589 for instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e on hv-cinder-82002 Aug 17 20:28:38.092608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-104b41ba-3bdb-44a6-8ed4-c50ce3300bb8 req-a61520a0-e526-4f89-81ad-00d0e2a5521d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032535 Aug 17 20:28:38.093209 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 580/1133] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:38.491268 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:38.491860 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:38.499060 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.499522 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.499995 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.500686 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.501141 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.501576 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.647485 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:38.658127 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a1b87ef6-b61b-4c10-bb70-4998f91892ef tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.171338 Aug 17 20:28:38.658711 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 554/1134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:38 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:39.681039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:39.681827 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:39.689221 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:39.689747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:39.690176 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:39.690887 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:39.691333 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:39.691751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:39.837564 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:39.846406 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7467fe75-a421-4a6a-9175-30ce3a1a454c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1266 microversion: 2.1 time: 0.170329 Aug 17 20:28:39.847367 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 581/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:39 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:40.868327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:40.868959 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:40.877676 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:40.878327 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:40.878933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:40.879866 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:40.880487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:40.881053 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:41.039169 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:41.047408 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2ef4c302-1609-4a97-91b4-c6a2c84a9822 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1452 microversion: 2.1 time: 0.183129 Aug 17 20:28:41.047965 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 555/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:40 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:41.070594 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:41.071468 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:41.080842 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:41.081387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:41.082122 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:41.083295 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:41.083988 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:41.084538 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:41.223319 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:41.231751 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-af681ebf-a2c0-438b-a7c1-0f804bd2e45b tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1452 microversion: 2.1 time: 0.167600 Aug 17 20:28:41.232317 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 582/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:41 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:43.211253 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ed38e-01d0-4849-89c1-1abbf92bdc7e", "tag": "8fdbc168-d686-45a5-8cf6-f017a6c83589"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:43.221184 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:43.221691 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:43.222120 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:43.234647 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] Creating event network-changed:8fdbc168-d686-45a5-8cf6-f017a6c83589 for instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e on hv-cinder-82002 Aug 17 20:28:43.239786 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-87ab0454-f4bb-4d9e-b59a-7ab5a54ae99b req-a85f1b63-d926-47e4-8aec-43d94ddde93b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032559 Aug 17 20:28:43.240464 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 556/1138] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:12.460699 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:29:12.461473 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:29:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:29:44.014158 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:29:44.015068 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:30:45.970266 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:45.971489 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:45.973994 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e05548b-374a-499d-93a8-504220fce716] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 20:30:45.977018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=22 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:45.977018 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=50 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:45.979921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:45.979921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG dbcounter [-] [120819] Writing DB stats nova_cell1:SELECT=48 {{(pid=120819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:45.979921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:45.979921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:45.979921 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:45.980931 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:45.981432 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:45.981826 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:45.983128 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ed38e-01d0-4849-89c1-1abbf92bdc7e", "tag": "8fdbc168-d686-45a5-8cf6-f017a6c83589"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:45.994709 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:45.995206 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:45.995632 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:46.010478 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] Creating event network-changed:8fdbc168-d686-45a5-8cf6-f017a6c83589 for instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e on hv-cinder-82002 Aug 17 20:30:46.014853 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Going to try to terminate instance {{(pid=120819) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:30:46.016223 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-8357233f-1810-4eea-91af-eb7b1d6338f2 req-ec09a43e-0199-452f-8765-17bef3c6904c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046236 Aug 17 20:30:46.019947 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 557/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:30:46.111604 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-7e410d4c-392a-4100-a4db-11192fe42dc7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "DELETE /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 204 len: 0 microversion: 2.1 time: 0.145906 Aug 17 20:30:46.112731 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 583/1140] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:30:45 2022] DELETE /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:30:46.128022 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:46.129255 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:46.139463 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:46.139955 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:46.140428 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:46.141125 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:46.141641 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:46.142073 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:46.293992 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:46.301726 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b8c7743-232b-43cb-8370-a3adfb4b5f7f tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1577 microversion: 2.1 time: 0.182057 Aug 17 20:30:46.302287 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 558/1141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:46 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:47.327159 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:47.328211 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:47.335116 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:47.335592 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:47.336024 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:47.336789 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:47.337235 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:47.337676 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:47.486802 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:47.494959 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-9cc2bc32-ae3f-4691-9e05-e18e0f55adc0 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1577 microversion: 2.1 time: 0.172830 Aug 17 20:30:47.495542 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 584/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:47 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:48.516483 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:48.517097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:48.530462 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:48.530902 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:48.531525 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:48.532198 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:48.532648 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:48.533059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:48.534770 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e05548b-374a-499d-93a8-504220fce716] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49758. Aug 17 20:30:48.559591 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ed38e-01d0-4849-89c1-1abbf92bdc7e", "name": "network-vif-deleted", "tag": "8fdbc168-d686-45a5-8cf6-f017a6c83589"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:48.577060 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:48.578125 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:48.579021 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:48.596568 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] Creating event network-vif-deleted:8fdbc168-d686-45a5-8cf6-f017a6c83589 for instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e on hv-cinder-82002 Aug 17 20:30:48.601863 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-c4b1e8f4-20b9-4b50-a6a9-786edf6b619f req-d0a6695c-dc14-42be-b2b9-bde6fb5b419e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049195 Aug 17 20:30:48.602544 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 585/1143] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:48.611218 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:48.619409 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-97f38622-095f-4f33-8fc8-c1518608f74e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 200 len: 1390 microversion: 2.1 time: 0.106850 Aug 17 20:30:48.620057 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 559/1144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:48 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 1390 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:49.642190 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:49.642804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 202ed38e-01d0-4849-89c1-1abbf92bdc7e] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:49.650131 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:49.650613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:49.651049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:49.651747 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:49.652193 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:49.652613 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:49.667036 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] HTTP exception thrown: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Request method failure captured: Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e HTTP/1.1 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_U4huvmJ16Uc8gUfV-_6-HHJ4cryTlF1N1LTDNc9Au2ph6GHrDcC7nd5FB6q5Lz4i_pBJMbjweyC3oeTla-IL5LywfYqx3Tl0RRRphUoy42pD0YUcTZQvFf1_WR_bvzdfdCXn-dNMwiPuWbCe-D_HVXzDXls0f8Peb0T67uFwd_fSbo Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:30:49.668736 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: e0240700f55f4376a51483fd0f15dd48 Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. Aug 17 20:30:49.671456 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '202ed38e-01d0-4849-89c1-1abbf92bdc7e'} Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:49.672833 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. Aug 17 20:30:49.675732 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:49.678365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Returning 404 to user: Instance 202ed38e-01d0-4849-89c1-1abbf92bdc7e could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:49.678365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-c99844d9-7d66-4d7b-bf44-c94a4e34dc1c tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e" status: 404 len: 111 microversion: 2.1 time: 0.032458 Aug 17 20:30:49.678365 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 586/1145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:49 2022] GET /compute/v2.1/servers/202ed38e-01d0-4849-89c1-1abbf92bdc7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:30:52.870567 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6421ee2-8c5d-49eb-b13c-d5d8660c112c", "tag": "398b46fe-edc0-4c7f-bf1a-63a4792947ea"}]} {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:52.876872 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:52.877364 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:52.887409 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:52.887876 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:52.888059 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:52.888487 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:52.888636 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:52.888926 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:52.889650 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:52.890097 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:52.890516 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:52.901426 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.compute.server_external_events [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] Creating event network-changed:398b46fe-edc0-4c7f-bf1a-63a4792947ea for instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c on hv-cinder-82002 Aug 17 20:30:52.908303 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [req-27e69080-d728-4612-96ad-37f8fe23ac73 req-7e71e0f4-a39d-4bbf-b222-16ba9140842b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041269 Aug 17 20:30:52.909316 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 587/1146] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:52.918467 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:30:53.014936 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f81b0947-3494-4705-97ea-6d44e8194fd7 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 204 len: 0 microversion: 2.1 time: 0.150582 Aug 17 20:30:53.016299 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 560/1147] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:30:52 2022] DELETE /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:30:53.026664 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:53.027804 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:53.035167 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:53.035720 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:53.036302 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:53.037028 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:53.037475 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:53.037940 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:53.192093 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:53.200230 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-2ee2bb5b-7344-49e4-9971-ebd47202bf6e tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1578 microversion: 2.1 time: 0.178188 Aug 17 20:30:53.200945 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 588/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:53 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:54.225091 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:54.226062 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:54.232595 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:54.233094 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:54.233528 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:54.234258 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:54.234707 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:54.235126 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:54.390172 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:54.398145 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-867c94c7-a675-42af-9047-8c60e1859a30 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1578 microversion: 2.1 time: 0.177368 Aug 17 20:30:54.398713 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 561/1149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:54 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:55.424715 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:55.425276 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:55.432351 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:55.432918 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:55.433364 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:55.434121 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:55.434569 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:55.434987 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:55.512701 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.policy [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0240700f55f4376a51483fd0f15dd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ecb49247654d5f92cf32c4fbb01845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120819) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:55.523996 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-23e7346f-3a3e-4d83-b4a5-c0ed56597d31 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 200 len: 1391 microversion: 2.1 time: 0.105283 Aug 17 20:30:55.525000 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 589/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:55 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 1391 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:55.586596 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6421ee2-8c5d-49eb-b13c-d5d8660c112c", "name": "network-vif-deleted", "tag": "398b46fe-edc0-4c7f-bf1a-63a4792947ea"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:55.598479 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:55.598957 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:55.599524 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:55.612670 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] Creating event network-vif-deleted:398b46fe-edc0-4c7f-bf1a-63a4792947ea for instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c on hv-cinder-82002 Aug 17 20:30:55.618627 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-ce903968-130c-4800-be39-1ff582b73c17 req-63312d7a-1ae6-493c-a495-d7e3b9795068 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035918 Aug 17 20:30:55.619254 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 562/1151] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:56.547439 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:56.548003 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: d6421ee2-8c5d-49eb-b13c-d5d8660c112c] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:56.555130 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:56.555608 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:56.556039 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:56.556718 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:56.557188 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:56.557632 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:56.573084 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] HTTP exception thrown: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Request method failure captured: Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c HTTP/1.1 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_U4huvmJ16Uc8gUfV-_6-HHJ4cryTlF1N1LTDNc9Au2ph6GHrDcC7nd5FB6q5Lz4i_pBJMbjweyC3oeTla-IL5LywfYqx3Tl0RRRphUoy42pD0YUcTZQvFf1_WR_bvzdfdCXn-dNMwiPuWbCe-D_HVXzDXls0f8Peb0T67uFwd_fSbo Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:30:56.574956 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: e0240700f55f4376a51483fd0f15dd48 Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. Aug 17 20:30:56.576725 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': 'd6421ee2-8c5d-49eb-b13c-d5d8660c112c'} Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:56.579691 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. Aug 17 20:30:56.581454 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:56.583385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Returning 404 to user: Instance d6421ee2-8c5d-49eb-b13c-d5d8660c112c could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:56.583385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-ca1a5e7d-9e63-4194-9dd3-bf02296117d3 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c" status: 404 len: 111 microversion: 2.1 time: 0.033339 Aug 17 20:30:56.583385 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 590/1152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:56 2022] GET /compute/v2.1/servers/d6421ee2-8c5d-49eb-b13c-d5d8660c112c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:30:57.047698 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:57.048284 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:57.056935 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:57.057414 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:57.057862 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:57.058772 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:57.059219 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:57.059639 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:57.073900 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] HTTP exception thrown: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Request method failure captured: Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 HTTP/1.1 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept: application/json Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Connection: close Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Length: 0 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Content-Type: application/json Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Host: 10.222.0.18 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABi_U4huvmJ16Uc8gUfV-_6-HHJ4cryTlF1N1LTDNc9Au2ph6GHrDcC7nd5FB6q5Lz4i_pBJMbjweyC3oeTla-IL5LywfYqx3Tl0RRRphUoy42pD0YUcTZQvFf1_WR_bvzdfdCXn-dNMwiPuWbCe-D_HVXzDXls0f8Peb0T67uFwd_fSbo Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Role: reader,member Aug 17 20:30:57.075572 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Id: e0240700f55f4376a51483fd0f15dd48 Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: method: > Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: exception: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.077649 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: action_args: {'id': '1e372d84-2817-4bab-863a-b9ee8741f825'} Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:57.078966 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.081109 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.082914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Returning 404 to user: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:57.082914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-752fa3e6-4c8a-4d42-b41f-e149d5dd9d50 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 404 len: 111 microversion: 2.1 time: 0.035415 Aug 17 20:30:57.082914 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 563/1153] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 17 20:30:57 2022] DELETE /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:30:57.088875 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '>' {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:57.089387 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.compute.api [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [instance: 1e372d84-2817-4bab-863a-b9ee8741f825] Fetching instance by UUID {{(pid=120819) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:57.096888 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:57.097368 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:57.097831 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:57.098529 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Acquiring lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:57.098970 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:57.099428 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG oslo_concurrency.lockutils [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Lock "cd013e9c-b514-4885-856a-d0c5ccdf15e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:57.114962 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.wsgi [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] HTTP exception thrown: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Request method failure captured: Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: request: GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 HTTP/1.1 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept: application/json Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Accept-Encoding: identity Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Connection: close Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Length: 0 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Content-Type: application/json Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Host: 10.222.0.18 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Openstack-System-Scope: None Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Auth-Token: gAAAAABi_U4huvmJ16Uc8gUfV-_6-HHJ4cryTlF1N1LTDNc9Au2ph6GHrDcC7nd5FB6q5Lz4i_pBJMbjweyC3oeTla-IL5LywfYqx3Tl0RRRphUoy42pD0YUcTZQvFf1_WR_bvzdfdCXn-dNMwiPuWbCe-D_HVXzDXls0f8Peb0T67uFwd_fSbo Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Id: None Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Domain-Name: None Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Identity-Status: Confirmed Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Is-Admin-Project: True Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Id: default Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Domain-Name: Default Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Project-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Role: reader,member Aug 17 20:30:57.116501 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Roles: reader,member Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e7ecb49247654d5f92cf32c4fbb01845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Id: e7ecb49247654d5f92cf32c4fbb01845 Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-Tenant-Name: tempest-TestVolumeBootPattern-1494861037 Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Id: default Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Domain-Name: Default Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Id: e0240700f55f4376a51483fd0f15dd48 Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: X-User-Name: tempest-TestVolumeBootPattern-1494861037-project Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: method: > Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: exception: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.118512 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: action_args: {'id': '1e372d84-2817-4bab-863a-b9ee8741f825'} Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: {{(pid=120819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:57.119661 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. Aug 17 20:30:57.121522 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: ERROR nova.api.openstack.wsgi Aug 17 20:30:57.123049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: DEBUG nova.api.openstack.wsgi [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Returning 404 to user: Instance 1e372d84-2817-4bab-863a-b9ee8741f825 could not be found. {{(pid=120819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:57.123049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO nova.api.openstack.requestlog [None req-5f68089b-a615-463d-8cdc-b6bed92aee29 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825" status: 404 len: 111 microversion: 2.1 time: 0.033954 Aug 17 20:30:57.123049 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: [pid: 120819|app: 0|req: 591/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:57 2022] GET /compute/v2.1/servers/1e372d84-2817-4bab-863a-b9ee8741f825 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:30:58.460077 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5c8b30e0-2ffc-481d-bd8b-af63969c0ad6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] Calling method '.version_select at 0x7faaacd04d30>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:58.468800 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5c8b30e0-2ffc-481d-bd8b-af63969c0ad6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:30:59.475335 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [None req-5c8b30e0-2ffc-481d-bd8b-af63969c0ad6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] [1b7bac12-3665-4db0-b885-c7dbf8e67ad2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49814. Aug 17 20:30:59.503677 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5c8b30e0-2ffc-481d-bd8b-af63969c0ad6 tempest-TestVolumeBootPattern-1494861037 tempest-TestVolumeBootPattern-1494861037-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-194102395" status: 202 len: 0 microversion: 2.1 time: 1.048964 Aug 17 20:30:59.504618 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 564/1155] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Aug 17 20:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-194102395 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:31:21.486013 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:31:21.486733 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:32:32.470647 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:32:32.471899 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:33:04.023785 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:33:04.024448 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:33:21.929067 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:33:21.929933 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:34:41.497575 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:34:41.498103 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:34:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:35:52.482327 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:35:52.483184 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:35:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:36:13.159148 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:36:13.159815 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:36:24.033309 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:36:24.034015 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:36:41.838467 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:36:41.839132 dv-cinder-820027-19-iscsi devstack@n-api.service[120819]: Wed Aug 17 20:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:36:41.938324 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:36:41.938924 dv-cinder-820027-19-iscsi devstack@n-api.service[120818]: Wed Aug 17 20:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!